Malware Learning Machine: AI-based Malware Classifier Project

Technical Issues Continued I spent the end of week 5 and the beginning of week 6 with a few more problems using PyTorch, Skorch and SciKit-Learn together, partly due to a lack of clear documentation about the data certain classes and functions expect. After a lot of tweaking I managed to get a model running, but it wasn't learning anything -- the loss function was returning either infinity or zero. After a lot of tweaking, resulting in even more errors, I decided to scrap Skorch and SK-Learn, and write the model selection code myself. After two weeks spent debugging, I managed to get a concurrent gridsearch/k-folds cross-validation implementation up and running in an evening. (I wasn't sure how to feel about that -- annoyed that I had wasted so much time when the solution was staring my in the face, or glad that I finally had something that worked and could stop worrying about problems in other people's code.) I'm still making improvements -- at the moment there is a...

Technical Issues! So, first, I've completely deviated from my planned posting schedule due to a series of somewhat embarrassing technical problems I've experienced. Everything from difficulties building frameworks due to dependency hell, to realising that they either won't do what I want to do with them or lack documentation and provide examples which don't compile, to Windows kernel bugs and hosing my Linux distro by switching from the Stable branch to Testing. Programming Languages Continued Near the end of the second week, I still hadn't fully settled on the language. After speaking with Martin about my difficulties with F# and JavaScript, and my general dislike of Python, I decided, with Martin's encouragement, to try Haskell. I learned Haskell during my undergraduate degree and found it a very expressive language with a reasonable amount of library support at a very high (i.e. abstract) level. Enough to write my undergraduate dissertation project, an ...