Construction Notebook for:
Sentiment Language Model Trained on Amazon Product Review Data
Construction Notebook for:
Sentiment Language Model Trained on Amazon Product Review Data
Sentiment Language Model Trained on Amazon Product Review Data
NetModel Access
NetModel Access
This Notebook
This Notebook
NetModel["Sentiment Language Model Trained on Amazon Product Review Data","ConstructionNotebook"]
Untrained Net
Untrained Net
NetModel["Sentiment Language Model Trained on Amazon Product Review Data","UninitializedEvaluationNet"]
Trained Net
Trained Net
NetModel["Sentiment Language Model Trained on Amazon Product Review Data"]
Net Construction
Net Construction
Intermediate Nets
Intermediate Nets
In[]:=
core=NetGraph[<|"h0"PartLayer[1;;4096],"c0"PartLayer[4097;;8192],"wx"LinearLayer[4*4096,"Biases"None],"wh"LinearLayer[4*4096],"wmx"LinearLayer[4096,"Biases"None],"wmh"LinearLayer[4096,"Biases"None],"mult1"ThreadingLayer[Times],"add1"ThreadingLayer[Plus],"i"PartLayer[1;;4096],"f"PartLayer[4097;;8192],"o"PartLayer[8193;;12288],"u"PartLayer[12289;;16384],"iSig"ElementwiseLayer[LogisticSigmoid],"fSig"ElementwiseLayer[LogisticSigmoid],"uTanh"Tanh,"oSig"ElementwiseLayer[LogisticSigmoid],"mult2"ThreadingLayer[Times],"mult3"ThreadingLayer[Times],"cy"ThreadingLayer[Plus],"cyTanh"Tanh,"hy"ThreadingLayer[Times],"finalCat"CatenateLayer[]|>,{NetPort["Input"]"wx",NetPort["Input"]"wmx",NetPort["State"]{"h0","c0"},"h0""wmh",{"wmx","wmh"}"mult1","mult1""wh",{"wh","wx"}"add1","add1""i""iSig","add1""f""fSig","add1""u""uTanh","add1""o""oSig",{"iSig","uTanh"}"mult2",{"fSig","c0"}"mult3",{"mult2","mult3"}"cy","cy""cyTanh",{"cyTanh","oSig"}"hy",{"hy","cy"}"finalCat"},"Input"64,"State"8192]
Out[]=
NetGraph
Final Net
Final Net
In[]:=
sentimentLM=NetGraph[<|"Embed"EmbeddingLayer[64],"MLSTM"NetFoldOperator[core],"Scores"LinearLayer[248],"LastStates"SequenceLastLayer[],"LastHidden"PartLayer[{1;;4096}],"Softmax"SoftmaxLayer[]|>,{NetPort["Input"]"Embed"NetPort["MLSTM","Input"],NetPort["InputStates"]NetPort["MLSTM","State"],"MLSTM""LastStates""LastHidden""Scores""Softmax"NetPort["Output"],"LastStates"NetPort["OutputStates"]},"Input"NetEncoder["UTF8"],"Output"NetDecoder[{"Class",Range[248]}]]
Out[]=
NetGraph
Training
Training
(Performed separately)