ok so i read it on the wiki and heres what i found
"Even before being effected by the abilities of the Memory Worm, survivors that are near or in the presence of it will feel a sense of nostalgia, and a "off-putting comfort that feels inappropriate." which will cause subdue illusions

That’s cool

does memory worm suck your memories because im just guessing and ive never heard someone talk about it