InTowards AIbyAla Falaki, PhDFine-Tune BART for Translation on WMT16 Dataset (and Train new Tokenizer)BART is a well-known summarization model. Also, it can do the translation task with the appropriate tokenizer for the target language.Mar 13, 20231Mar 13, 20231
InTowards AIbyAla Falaki, PhDCompressedBART: Fine-Tuning for Summarization through Latent Space Compression (Paper…Paper title: A Robust Approach to Fine-tune Pre-trained Transformer-based Models for Text Summarization through Latent Space Compression.Apr 7, 2023Apr 7, 2023
InTowards AIbyAla Falaki, PhDHow To Do Effective Paraphrasing Using Huggingface and Diverse Beam Search? (T5, Pegasus,…)The available paraphrasing models usually don’t perform as advertised. However, some techniques can help you easily get the most out of…Sep 12, 2022Sep 12, 2022
InTowards AIbyAla Falaki, PhDAttention Visualizer Package: Showcase Highest Scored Words Using RoBERTa ModelThis library lets you easily see which words contribute the most in terms of self-attention score in each layer and head to the output…Jan 24, 2022Jan 24, 2022
InTowards AIbyAla Falaki, PhDLet AI Write Stories for You!! (Using GPT-J)The family of GPT models keeps improving the quality of the generated text to the point that they are now being used to write blog posts.Dec 15, 2021Dec 15, 2021
Ala Falaki, PhDIs it possible to do Sentiment Analysis on unlabeled data using BERT? (Feat. Vader) [Experiment]Supervised learning algorithms like Artificial Neural Networks (ANN) basically rely on examples to learn from. Each instance should be a…Apr 23, 20213Apr 23, 20213
InTowards AIbyAla Falaki, PhDHow much DEEP learning do we need?The growing trend of large pre-trained networks is worrying. It could send the message that Deep Learning is not for everyone.Aug 4, 2021Aug 4, 2021
InTowards AIbyAla Falaki, PhDIs it possible to do Text Classification on unlabeled data? (Feat. Zero-Shot Classification)In this piece we will explore the zero-shot classification method for sentiment analysis using the Huggingface library.Aug 30, 20211Aug 30, 20211