Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPIKE]: How are we going to validate if tweets are organic or not? #329

Open
Luka-Loncar opened this issue Dec 18, 2024 · 3 comments
Open
Labels
59 Subnet 59 spike

Comments

@Luka-Loncar
Copy link
Collaborator

A Discord member raised a few questions - link to message https://discord.com/channels/799672011265015819/1310617172132888639/1318704900280160307

Message:
he best agents naturally rise to the top through real user engagement and value accrual
Market forces directly drive AI development and improvement
Agents compete for attention, engagement, and economic value
Success is measured in real-world impact, not just technical metrics
The subnet becomes a financially incentivized benchmark for the best sentient AI Agents

how will you validate any of this will be organic?
its actually all very easy to fake
engagement, economic value,..
so while in practice it sounds good, i have a few questions/concerns

-fake traffic/engagement (if google ads cant distinguish, we surely wont)
-people will contribute economic value based on the incentive they get, will just be arbed
-Success is measured in real-world impact, not just technical metrics -> can you elaborate?
-ai agents are quite difficult to benchmarks, now they are useless chatbots but as they progress agents will be operating in different areas
exciting idea, looking forward to the answers

@Luka-Loncar
Copy link
Collaborator Author

Is this still relevant issue, or we have solved this in some other issue maybe? @grantdfoster

@Luka-Loncar Luka-Loncar added spike 59 Subnet 59 labels Jan 20, 2025
@grantdfoster
Copy link
Contributor

This is at least somewhat captured in the v4 scoring ticket!

@grantdfoster
Copy link
Contributor

Also FYI, this is filed under the wrong repo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
59 Subnet 59 spike
Projects
None yet
Development

No branches or pull requests

2 participants