Week 7 : Coding Period

-
I have finished converting the pruned models to tflite format. I have done dynamic, float16 and int8 quantization. I have also evaluated their results to be presented shortly.

Currently I am working on the chest-xray14 models. I am using onnx to convert benchmark pytorch models to tensorflow format by using an intermediate onnx format. I am also implementing knowledge distillation by writing my own code for it. The available code is having issues storing the soft targets and I am finding a way to work around that. The code available on Github is in pytorch and cannot be used on my models. The available code in tensorflow is outdated and is not working correctly.

So for the next week, I will be working on chestx-ray14 as well as knowledge distillation simultaneously. The knowledge distillation script will be reusable for both the datasets. I hope to complete these modules in the upcoming days.

Happy Coding :)

Comments

Post a Comment

Popular posts from this blog

GSoC 2020 with LibreHealth : Final Report

-
Image
Low Powered Models for Disease Detection and Classification for Radiology Images Project Description - The aim of this project is to create Deep Learning models for detection and classification of radiology images. The models must be compressed such that they can be deployed to low powered devices like ARM devices, Android devices, etc. Compression techniques such as Quantization and Pruning can be used.     Mentors - Priyanshu Sinha Saptarshi Purkayastha Judy Gichoya Geeta Priya Padmanabhan Tech Stack -  Numpy Pandas PyDicom Tensorflow Tensorflow-Lite/ Tensorflow-Model-Optimization Docker Qemu Project Link - Click here Commits - Click here    Merge Requests - Click here Why to do this - There has been a lot of progress in developing Machine Learning models that predict the medical condition of a patient based upon specific inputs relevant to the diagnosis of that condition. However, these models have drawbacks while deployment in real-time on edge devices. Firstly, they have been trai
Read more

Week 5 : Coding period

-
Week 5 Update - Today I received the results of my first evaluation and I have passed!! Woohoo! I am happy that my mentors are happy with my work. They have asked me to improve my code by making it more reusable. So I will work on this feedback in the upcoming weeks. Work update for this week - I have (finally) successfully implemented int8 quantization. Although I had to migrate everything to Colab for this, it finally run. Even though my code is split on various platforms, I am happy that most of what I have implemented is running well on my local machine. The 2nd thing that I did this week was make python scripts for every module of my notebook. I made scripts for dataset preprocessing, model building, model training, quantization and pruning. I am now adding inference scripts for large as well as compressed models. This is the part that I have to make more reusable. I also have to cover the edge cases and erroneous inputs for these scripts. I want to present the results of
Read more

Week 1 : Acceptance and Community Bonding

-
Image
Introduction My name is Aishwarya Harpale and I am a Senior year Computer Engineering student from Pune Institute of Computer Technology, Pune. I was selected for GSoC 2020 to contribute to the Open Source Organization — LibreHealth. The project that I will be working on is “Low Powered Models for Disease Detection and Classification for Radiology Images”. I will explain a bit about my journey until now. Pre-GSoC Period After the organizations were announced, I began looking for projects that came under the category of Machine Learning. LibreHealth’s projects caught my eye and I felt that I could contribute to those projects using my knowledge. As students, we were asked to develop a Proof of Concept(PoC) so that the mentors could evaluate our coding skills. I developed an application for Classification and Localization of Chest-XRay images. This application had a front-end developed using Bootstrap and it was deployed on a Flask server. For further detai
Read more