Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

/about pages never linked to from website - is this intentional or a bug? #10

Open
lordmatt opened this issue Mar 1, 2024 · 1 comment
Open

/about pages never linked to from website - is this intentional or a bug? #10

lordmatt opened this issue Mar 1, 2024 · 1 comment

Comments

@lordmatt
Copy link

lordmatt commented Mar 1, 2024

On the website, the .about pages link to the domain, not domain/about and results show text from the front page too.

Is this a bug or intended behaviour?
@lordmatt lordmatt changed the title /about pages never linked to from website - is this intentional or a bug /about pages never linked to from website - is this intentional or a bug? Mar 1, 2024
@phgn0
Copy link
Contributor

phgn0 commented Mar 3, 2024

It's intentional. If a website doesn't have a /about page the scraper tries / instead. For example my own personal website is so simple that I put all about information on the home page, and I wanted to handle that.

Do you have an idea of how we can make this less confusing?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lordmatt @phgn0