Skip to content

Implementation of a Bigram Language Model from scratch using Pytorch

Notifications You must be signed in to change notification settings

phanibhushanksa/bigram_implementation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bigram_implementation

  • This repo contains Implementation of a Bigram Language Model from scratch using Pytorch
  • The names.txt contains appox ~32K names
  • After creating a bigram model, we evaluate it using Negative Log Likelihood loss function
  • In Part-2, we use a Neural Network to generate random names based on Initial input
  • We see the comparision between the Probability model we created and the Neural Networks model

About

Implementation of a Bigram Language Model from scratch using Pytorch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published