PET: Parameter-efficient Knowledge Distillation on Transformer.

Given a large Transformer model, how can we obtain a small and computationally efficient model which maintains the performance of the original model? Transformer has shown significant performance improvements for many NLP tasks in recent years. However, their large size, expensive computational cost, and long inference time make it challenging to deploy them to resource-constrained devices. Existing Transformer compression methods mainly focus on reducing the size of the encoder ignoring the fact that the decoder takes the major portion of the long inference time.

Effect of platelet-rich plasma and platelet-rich fibrin on peri-implant bone defects in dogs.

The purpose of this study was to evaluate the effect of tooth ash and platelet-rich plasma (PRP), and platelet-rich fibrin (PRF) grafts into bone defects around implants on bone formation. Six adult dogs were used as experimental subjects. Graft materials were used to create a particulate material.

A comparative study of bone formation following grafting with different ratios of particle dentin and tricalcium phosphate combinations.

This study aimed to evaluate the bone regeneration relative to tooth powder and tricalcium phosphate (TCP) mixing ratios using the rabbit cranium defect model. The tooth powder was mixed with TCP in 1:1, 3:1, and 1:3 ratios, and the different ratios were implanted in the rabbit cranium defect for 4 and 8 weeks. Powders crystal structure evaluated using scanning electron microscopy (SEM), attenuated total reflectance-Fourier transform infrared spectroscopy (ATR-FTIR), and new bone formation (NBF) was analyzed using micro-computed tomography (CT) and histologic examination.

Novel insertion mutation of ABCB1 gene in an ivermectin-sensitive Border Collie.

P-glycoprotein (P-gp) is encoded by the ABCB1 gene and acts as an efflux pump for xenobiotics. In the Border Collie, a nonsense mutation caused by a 4-base pair deletion in the ABCB1 gene is associated with a premature stop to P-gp synthesis. In this study, we examined the full-length coding sequence of the ABCB1 gene in an ivermectin-sensitive Border Collie that lacked the aforementioned deletion mutation.

Gastrointestinal tract cancer screening using fecal carcinoembryonic antigen.

There is a great need to detect gastrointestinal tract cancer at an early stage. It is well known that most carcinoma tissues of the gastrointestinal tract contain carcinoembryonic antigen (CEA). Stools are a rich source of cells derived from the gastrointestinal tract.