Publications by authors named "Avazov Kuldashboy"
Article Synopsis
- The paper presents a new image classification technique that utilizes knowledge distillation, focusing on a lightweight model based on a modified AlexNet architecture with depthwise-separable convolution layers.
- The unique Teacher-Student Collaborative Knowledge Distillation (TSKD) method allows the student model to learn from both the final output and intermediate layers of the teacher model, enhancing knowledge transfer and engagement in the learning process.
- The model is optimized for low computational resources while maintaining high accuracy in image classification tasks, featuring specialized loss functions and architectural enhancements that balance complexity and efficiency.
