Notebook - Welcome to Notebook

Contact/Report Bugs
You can contact me at: bkenwright@xbdev.net












Latent Dirichlet allocation LDA topic modeling in javascript see http en wikipedia org wiki Latent Dirichlet allocation Implementation References Based on original javascript implementation https github com awaisathar lda js NPM Library https www npmjs com package lda script src https cdnjs cloudflare com ajax libs jquery 3 6 0 jquery min js script script src https cdn rawgit com awaisathar lda js gh pages js stopwords js script script src https cdn rawgit com awaisathar lda js gh pages js lda js script script Example document var text Cats are small Dogs are big Cats like to chase mice Dogs like to eat bones Extract sentences and builds vocab var documents new Array var sentences text var f var vocab new Array var docCount 0 for var i 0 i sentences length i if sentences i continue var words sentences i split s if words continue var wordIndices new Array for var wc 0 wc words length wc var w words wc toLowerCase replace a z A Z0 9 g TODO Add stemming if w w length 1 stopwords w w indexOf http 0 continue if f w f w f w 1 else if w f w 1 vocab push w wordIndices push vocab indexOf w if wordIndices wordIndices length 0 documents docCount wordIndices console log vocab vocab console log documents documents Run LDA to get terms for 2 topics var V vocab length var M documents length var K 2 number of topics var alpha 0 1 per document distributions over topics var beta 01 per topic distributions over words lda configure documents V 10000 2000 100 10 lda gibbs K alpha beta var theta lda getTheta var phi lda getPhi console log number of topics phi length build topic word lists let topics topics var topTerms 20 max topics var topicText new Array for var k 0 k phi length k var tuples new Array for var w 0 w phi k length w tuples push phi k w toPrecision 2 vocab w tuples sort reverse if topTerms vocab length topTerms vocab length for var t 0 t topTerms t var topicTerm tuples t split 1 var prob parseInt tuples t split 0 100 if prob 0 0001 continue console log topic k topicTerm prob if topics k undefined topics k topics k push topicTerm console log topics topics script Shows example of a circle hierarchy using d3 style circle fill rgb 31 119 180 fill opacity 25 stroke rgb 31 119 180 stroke width 1px leaf circle fill ff7f0e fill opacity 1 text font 10px sans serif style script src https d3js org d3 v6 min js script script var w 300 var h 300 var pack d3 pack size w 4 h 4 padding 2 var svg d3 select body append svg attr width w attr height h var json name flare children name analytics children name cluster children name AgglomerativeCluster size 3938 name CommunityStructure size 3812 name HierarchicalCluster size 6714 name MergeEdge size 743 var root d3 hierarchy json sum function d return d size sort function a b return b size a size let g svg append g var node g selectAll node data pack root descendants enter append g attr class function d return d children node leaf node attr transform function d return translate d x d y node append circle attr r function d return d r node filter function d return d children append text attr dy 0 3em text function d return d data name substring 0 d r 3 console log done document body style height 600px script script src https cdnjs cloudflare com ajax libs jquery 3 6 0 jquery min js script script src https cdn rawgit com awaisathar lda js gh pages js stopwords js script script src https cdn rawgit com awaisathar lda js gh pages js lda js script script src https d3js org d3 v6 min js script style circle fill rgb 31 119 180 fill opacity 25 stroke rgb 31 119 180 stroke width 1px leaf circle fill ff7f0e fill opacity 1 text font 10px sans serif style script Example document var text Cats are small Dogs are big Cats like to chase mice Dogs like to eat bones Extract sentences and builds vocab var documents new Array var sentences text var f var vocab new Array var docCount 0 for var i 0 i sentences length i if sentences i continue var words sentences i split s if words continue var wordIndices new Array for var wc 0 wc words length wc var w words wc toLowerCase replace a z A Z0 9 g TODO Add stemming if w w length 1 stopwords w w indexOf http 0 continue if f w f w f w 1 else if w f w 1 vocab push w wordIndices push vocab indexOf w if wordIndices wordIndices length 0 documents docCount wordIndices console log vocab vocab console log documents documents Run LDA to get terms for 2 topics var V vocab length var M documents length var K 2 number of topics var alpha 0 1 per document distributions over topics var beta 01 per topic distributions over words lda configure documents V 10000 2000 100 10 lda gibbs K alpha beta var theta lda getTheta var phi lda getPhi console log number of topics phi length build topic word lists let topics topics var topTerms 20 max topics var topicText new Array for var k 0 k phi length k var tuples new Array for var w 0 w phi k length w tuples push phi k w toPrecision 2 vocab w tuples sort reverse if topTerms vocab length topTerms vocab length for var t 0 t topTerms t var topicTerm tuples t split 1 var prob parseInt tuples t split 0 100 if prob 0 0001 continue console log topic k topicTerm prob if topics k undefined topics k name topicTerm children else topics k children push name topicTerm size prob 100 console log topics topics let json name root children topics you could save out the processed data load it for visualizing later e g JSON stringify var w 300 var h 300 var pack d3 pack size w 4 h 4 padding 2 var svg d3 select body append svg attr width w attr height h var root d3 hierarchy json sum function d return d size sort function a b return b size a size let g svg append g var node g selectAll node data pack root descendants enter append g attr class function d return d children node leaf node attr transform function d return translate d x d y node append circle attr r function d return d r node filter function d return d children append text attr dy 0 3em text function d return d data name substring 0 d r 3 console log ready document body style height 600px script

node filter function d return d children append text attr dy 0 3em text function d return d data name substring 0 d r 3 console log done document body style height 600px script script src https cdnjs cloudflare com ajax libs jquery 3 6 0 jquery min js script script src https cdn rawgit com awaisathar lda js gh pages js stopwords js script script src https cdn rawgit com awaisathar lda js gh pages js lda js script script src https d3js org d3 v6 min js script style circle fill rgb 31 119 180 fill opacity 25 stroke rgb 31 119 180 stroke width 1px leaf circle fill ff7f0e fill opacity 1 text font 10px sans serif style script Example document var text Cats are small Dogs are big Cats like to chase mice Dogs like to eat bones Extract sentences and builds vocab var documents new Array var sentences text var f var vocab new Array var docCount 0 for var i 0 i sentences length i if sentences i continue var words sentences i split s if words continue var wordIndices new Array for var wc 0 wc words length wc var w words wc toLowerCase replace a z A Z0 9 g TODO Add stemming if w w length 1 stopwords w w indexOf http 0 continue if f w f w f w 1 else if w f w 1 vocab push w wordIndices push vocab indexOf w if wordIndices wordIndices length 0 documents docCount wordIndices console log vocab vocab console log documents documents Run LDA to get terms for 2 topics var V vocab length var M documents length var K 2 number of topics var alpha 0 1 per document distributions over topics var beta 01 per topic distributions over words lda configure documents V 10000 2000 100 10 lda gibbs K alpha beta var theta lda getTheta var phi lda getPhi console log number of topics phi length build topic word lists let topics topics var topTerms 20 max topics var topicText new Array for var k 0 k phi length k var tuples new Array for var w 0 w phi k length w tuples push phi k w toPrecision 2 vocab w tuples sort reverse if topTerms vocab length topTerms vocab length for var t 0 t topTerms t var topicTerm tuples t split 1 var prob parseInt tuples t split 0 100 if prob 0 0001 continue console log topic k topicTerm prob if topics k undefined topics k name topicTerm children else topics k children push name topicTerm size prob 100 console log topics topics let json name root children topics you could save out the processed data load it for visualizing later e g JSON stringify var w 300 var h 300 var pack d3 pack size w 4 h 4 padding 2 var svg d3 select body append svg attr width w attr height h var root d3 hierarchy json sum function d return d size sort function a b return b size a size let g svg append g var node g selectAll node data pack root descendants enter append g attr class function d return d children node leaf node attr transform function d return translate d x d y node append circle attr r function d return d r node filter function d return d children append text attr dy 0 3em text function d return d data name substring 0 d r 3 console log ready document body style height 600px script

3dplot
a4print
about
acejs
acejs2
acejs3
aessecurity
angularjs
animbackgroundimage
aseformat
assert
asteroidsjs
backgrounds01
backgrounds02
backgrounds03
barnsleyfern
base26
base64
bib
binary
bodypix
bouncy
box2dweb
breakoutjs
browserversion
buslanes
busybutton
bvhreader
calendar
canvas
canvas2
canvas3
canvasmandelbrot
canvasmandelbrot2
canvasnumbers
canvaszoom
capsule
changingimages
chatgptusingopenai
chatgptusingopenai2
chatgptusingopenai3
checkboxtoggle
chinesetiles
classes
classfeatures
clipboardbutton
clonenode
codedropdown
codemirror
codemirror2
collada
colorpick
columnresizer
contextmenu
convnet
cookiebanner
countdown
countdown2
countdown3
crop
css3dbarchart
css3dbarchart2
css3dbook
css3dscene
csscube
csscube2
csscube3
csscubevideos
cssfilelist
csshas
csspulse
cssresizeaspect
cssspin
csszooming
csvtoarray
customcheckbox
d3datamap
d3js
d3js10
d3js11
d3js2
d3js3
d3js4
d3js5
d3js6
d3js7
d3js8
d3js9
d3jsanimatedgrid
d3jsarctransition
d3jsarctransition2
d3jsaxis
d3jsaxischanging
d3jsbars
d3jsbrushing
d3jsbuslanes
d3jsbuslanes2
d3jscalendar
d3jscheat
d3jsclock
d3jscloudmap
d3jscogs
d3jscolors
d3jscovid
d3jscovid2
d3jscovid3
d3jsdashboard
d3jsdashboard2
d3jsdashboard3
d3jsdatakeyfunction
d3jsdensity
d3jsdragresizing
d3jsdragresizing2
d3jseach
d3jsease
d3jsevents
d3jsflower
d3jsforcegroups
d3jsforces
d3jsforces2
d3jsfractaltree
d3jsgeo
d3jsgroupbars
d3jsgroups
d3jsheatmap
d3jshex
d3jshierarchies
d3jshierarchies2
d3jshistogram
d3jshistogram2
d3jshistogram3
d3jshistogram4
d3jsinterpolate
d3jsjoin
d3jskmean
d3jskmean2
d3jsline
d3jsline2
d3jsline3
d3jsline4
d3jslinetransition
d3jslinetransition0
d3jslinetransition2
d3jsmaplocations
d3jsmaps
d3jsmaps2
d3jsmaps3
d3jsmisc
d3jsmisc2
d3jsmodule
d3jsmodulecolor
d3jsmultistyles
d3jsnobel
d3jsoverlappinggraphs
d3jspanel
d3jspie
d3jspieinterpolate
d3jssankey
d3jssankey2
d3jsscatter
d3jsshapes
d3jsslider
d3jsspending
d3jsspending2
d3jsspiralplot
d3jsspirograph
d3jssquare
d3jsstack
d3jsstackedbar
d3jsstackedbar2
d3jssunburst
d3jssunmoon
d3jssvglines
d3jssymbols
d3jstimelines
d3jsuk
d3jsvoronoi
d3scatterplot
d3timeline
d3timeline2
datalist
datamuse
date
dblclickhighlight
deviceorientation
dictionaryapi
dockermenu
doodlepad
downloadgif
dragdroplistitems
dragrotateresizediv
dragrotateresizediv2
dragrotateresizediv3
dragrotateresizediv4
dragrotateresizefontsize
dragselectbrush
drawlinesdiv
dropdown
dualquaternionimages
dynamicgrid
easefunctions
easeinterpolate3dplots
echart
echart2
echart3
encapsulation
epubviewer
errorstack
excalidraw
excalidraw2
excalidraw3
excalidraw5
expandable
faker
fetchplus
fileupload
fixedtopbar
fonts
fonts2
footerbar
fractalmaze
fractalmaze2
fractalnoiseimage
fractals
fractals2
fractaltree
freesvg
fresnel
froggerjs
gantt
gifgiphyapi
gifhex
gltffromscratch
gradients
griditems
griditems2
griditems3
griditems4
gridworms
heat
hexview
hexview2
highlight
icons
icons2
iframes
ik
imagetracertosvg
imgur
inputfile
invadersjs
ipynb
ipynb2
ipynb3
ipynb4
isbn13
isbn2
jpghex
jquery
jquery2
jqueryui
jqueryui2
jsdraganddrop
jslint
jsobfuscate
jsraytracer
jstree
jstree2
jszip
jszipimages
jszipread
keyframes
l2dwidget
lda
leftmenu
less
less2
lineargradientimage
linenumbers
loadimagefromfile
makepdf
maps
markdown
markdown2
markdownalerts
markdownalerts2
markdownbookmarks
markovimage
markovpixelblocks
mathjax
matrices
matsandvects
mazegamejs
md2tex
metrotiles
metrowindows
milestones
misc
misc2
modules
myipdetails
neataptic
networkstructures
networkstructures2
number
obj
objtojson
openaiimages
opencv
opencv2
opencv3
opencv4
opencv5
outline
p2
p5fractalleaf
p5fractalshape
p5js
p5js2
p5js3
p5jsanimatedcover
p5mengercube
p5snowflakes
palindrome
panel
parallax
paste
paste2
pasteimgfromurl
pdfjs
pdfjs2
pdfkit
pdfkit2
pdfkit3
pdfkit4
pdfkit5
pdfkit6
pdfmake
pdfmake2
pdfmake3
pdfmake4
pdfmake5
pdfmake6
perlin
perlin2
perlin3
perspective
pexels
playground
plotly
plotlynoise
plotlyranddist
plyloader
plyloader2
pngtxtencoder
pongjs
pptxgenjs
prettycode
prism
prn
problems
progress
pseudorandom
px2svg
python
quotes
racergame
random
randomprofilepatterns
randomstring
rating
rayambient
raymonte
raymonteprogressive
raymonteprogressive2
raymontewarmstart
reexpcross
reexpcross2
regex
regexbib
regexpfixbib
regexpmultiline
repeatwordsregexp
resizabletable
resizabletable2
revealjs
revealjs2
revealjsmulti
ritalanguage
ritalanguage2
ritalanguage3
rotateimg
rough
rsapublicprivatekeys
rss
rss2
sankey
scrappingsvg
scrolltext
scrolltext2
scrollwidth
sdfboxinboxtwist
sdfhollowbox
setintervalexception
shareurl
shuffle
sidecomment
similarity
simplehighlighter
simpleplatformgamejs
sinecanvas
sliderpopout
slides
smileys
snowfall
snowman
sound
soundsignal
sphererayintersection
springs
sqljs
steganography
stereogram
stringmatching
svg
svgchaos
svgdragresize
svgdragresize2
svgdragresize3
svgdragrotate
svgdrawing
svglines
svglines2
svglines3
svglines4
svglines5
svglinesmandelbrot
svgpathsdragrotate
svgpathsdragrotateresize
svgpie
svgpie2
svgpie3
svgpiepath
svgpiepath2
svgrandomfaces
symbols
synaptic
synaptic2
synonyms
tablerotatecells
tablerotatecells2
tablerotatecells3
tablerotatecells3b
tablerotatecells4
tables
tablezebra
tabularjs
tabularjs2
tabulatordownload
tagcanvas
tensorflowgan
tensorflowjs
tensorflowjsbasic
tensorflowjscnn
tensorflowjssinewave
tensorflowjssound
tensorflowmobilenet
tetrahedronfractal
tetrahedronfractalfolding
tetris
textarea
textareaauto
textareadiv
textareadiv2
textmaskimage
theirorthere
thesaurus
threejs
threejs2
threejs3
threejs4
threejsgltf
threejstokyo
tiles
toaster
tooltip
transition
transitionexpandabledropdown
treeview
treeview2
tricks
tshirt
tshirt2
tshirt3
turningpages
unsplash
urlblob
urlblob2
userdefinepoints
vector
videos
videos2
visualsort
vue
w2ui
w2uientertextdialog
webcam
webgl
webgl2
webgl3
webgl4
webgl5
webglbasic1
webglbasic2
webglcube
webglfov
webglfrustum
webgljson
webglleaves
webgllighting
webglorthographic
webglpoints1
webglpoints2
webglpoints3
webglsquare
webgltexture1
webgltexture2
webgltexture3
webgltransforms
webgltriangle
webgpu
webgpu10
webgpu11
webgpu12
webgpu13
webgpu14
webgpu15
webgpu16
webgpu17
webgpu2
webgpu3
webgpu4
webgpu5
webgpu6
webgpu7
webgpu8
webgpu9
webgpubars
webgpubuffers
webgpubuffers2
webgpucellnoise
webgpuclouds
webgpuclydescope
webgpucompute
webgpucubemap
webgpucubemap2
webgpudeferred
webgpudepth
webgpudof
webgpudrops
webgpuetha
webgpufire
webgpufractalcubes
webgpuglassrain
webgpugltf
webgpugltf2
webgpugrass
webgpugrid
webgpukernel
webgpukleinian
webgpulabupdates
webgpulighting
webgpumandelbrot
webgpumeta3d
webgpumetaballs
webgpumouse
webgpunoise
webgpunormalmapping
webgpuobj
webgpuparallax
webgpuparallax2
webgpuparallax3
webgpuparallaxshadow
webgpuparallaxshadow2
webgpupixel
webgpuquad
webgpuray1
webgpuraytracing
webgpuraytracing2
webgpushadowmaps
webgpushadowmaps2
webgpusierpinski2d
webgpusierpinski3d
webgpusinusoid
webgpussao
webgpustadiumobj
webgpuswirl
webgputestpipe3
webgputoon
webgputopology
webgputt
webgpuvolcloud
webgpuwater
webgpuwireframe
webgpuwireframe2
webpcanvas
webworkers
webxr
webxr2
wiggly
wikipedia