Hello, first of all thanks for this amazing project, I am looking for a way to crawl websites to create assistants for them.
I tried the crawlSubpages parameter on few of my portfolio pages but I don't see subpages, links, on the page being crawled. Am I doing something wrong?
curl 'https://md.dhr.wtf/?url=https://aleksa.codes&crawlSubpages=true&llmFilter=true'