[–] 2 points 3 days ago

Nemotron Ultra is a open source and already gives DeepSeek R1 performance (admittedly not that good anymore). NVIDIA has open sourced the entire training process, including raw datasets and synthetic data generation. The raw data is mostly curated web crawl data.

  • source
  • parent
  • context
  • [–] 6 points 6 days ago

    Already happening for years.

    Amazon mechanical turk, Outlier.ai, scale ai, are all gig platforms that pay people to produce real human content for LLM training.

    At first they were paying people to actually produce content, like worked solutions to maths problems or translations, then they pivoted more to rating LLM output.

    And as with every enshittification cycle, wages and work rapidly dried up, so people responded by asking LLMs for the answer just to meet deadlines and get by.

  • source
  • parent
  • context
  • [–] 5 points 1 week ago

    Roommate finding platforms already have user profiles and allow other people to rate them. Browsing profiles and reviews in Facebook groups is the best argument against this.

  • source
  • view more: next ›