[–] 4 points 2 years ago

I don’t know how the karma thresholds work behind the scenes, but might I suggest for the bot to do a “top for” sort instead? Like it will only repost top content for the past 6 hours only. This will also help get more quality content as well and avoid reposting low effort/quality posts.

This is effectively already kinda how it works. For each subreddit it periodically (anywhere between every 30 minutes to every 12 hours, based on subscriber count and posts per day) requests the "hot" content feed. It then checks each post if it has at least 20 upvotes, and a 80% upvote to downvote ratio. Those numbers are configurable, but that's what they're currently set to - I believe they're a good mix between filtering out the complete garbage while still making sure it doesn't miss good content is.

  • source
  • parent
  • context
  •  

    A few months ago, I launched the Lemmit instance and bot (@bot@lemmit.online). Primarily, this was to help me stay up to date with some of the content I'd leave behind on Reddi. Additionally, I wanted to give back to the community, so I made it possible for anyone to request the archiving of subreddits to the Lemmit instance.

    However, this came with some unintended consequences. Notably, the most subscribed community on the instance has been !AmItheAsshole@lemmit.online. Even though it should have been obvious that there is no way to communicate with the Original Poster, given they're on Reddit.

    The pushback against the bot and the instance has increased over time. A recent post, This bot is bad for Lemmy, highlighted these concerns. I've also received similar feedback from admins of major Lemmy Instances and through direct PMs.

    As a response, last week I stopped accepting requests for archiving new subreddits. This weekend, I went a step further by discontinuing the archiving of a large amount of "interactive subreddits"—communities primarily centered around Q&A or communication with the Original Poster. This includes subs like !AskReddit@lemmit.online and !dating_advice@lemmit.online, as well as niche and support communities. Such discussions are better hosted on Reddit or Lemmy's equivalent spaces.

    I've also adjusted the post karma thresholds to curb spam posts. While this probably won't appease everyone, it should reduce the bot's posting frequency.

    Perhaps this might prompt some admins to rethink their choice to defederate from the Lemmit instance, or the banning of the bot. I'm not expecting anyone to, and won't take it personally if you don't, but I wanted to give the community this update nonetheless.

    In !about@lemmit.online there's a sticky post of all the Actively archived communities on the server (including NSFW ones, since that is not public without logging in), as well as the list of communities for which archiving is now disabled.

    Cheers!

    List of communities. (lemmit.online)
    submitted 2 years ago* (last edited 8 months ago) by [M] to c/about@lemmit.online
     

    Since it's impossible to see all the communities on here without logging in (mandatory NSFW filter), and I'm the only one with an account on here, here's a list of them. This list will be a snapshot, so the subscriber count will not be up to date, but I'm sure you'll figure it out.

    Ident NSFW Status Subscribers
    2000ccplus NSFW Enabled 36
    2007scape Enabled 13
    2137 Enabled 14
    2meirl4meirl Enabled 34
    2westerneurope4u Enabled 177
    3dprinting Enabled 61
    80sdesign Enabled 42
    90sdesign Enabled 25
    Boise Enabled 22
    Erotica NSFW Enabled 195
    IdiotsInCars Enabled 70
    InternetIsBeautiful Enabled 37
    MuseumOfReddit Enabled 36
    PerfectlyCutMeows Enabled 16
    ProgrammerHumor Enabled 193
    SFWdeepfakes Enabled 24
    Superstonk Enabled 101
    Ultralight Enabled 22
    abandonedporn Enabled 213
    aboringdystopia Enabled 34
    adviceanimals Enabled 48
    alternateangles Enabled 37
    altgirls NSFW Enabled 547
    amateurroomporn Enabled 24
    amazonposition NSFW Enabled 110
    anal NSFW Enabled 533
    anal_yiff NSFW Enabled 70
    analog Enabled 13
    androiddev Enabled 16
    ani_bm Enabled 13
    animalsbeingderps Enabled 22
    anime Enabled 76
    animemes Enabled 94
    anormaldayinrussia Enabled 28
    antimeme Enabled 11
    antiwork Enabled 119
    apksapps Enabled 14
    apple Enabled 27
    applevisionpro Enabled 13
    arizona Enabled 20
    arizonatrail Enabled 12
    artisanvideos Enabled 12
    asiansgonewild30plus NSFW Enabled 281
    atbge Enabled 12
    autism Enabled 16
    ayaneo Enabled 13
    bangmybully NSFW Enabled 117
    bapcsalescanada Enabled 16
    baseball Enabled 22
    battlebots Enabled 12
    battlestations Enabled 96
    bbw NSFW Enabled 178
    bbwbutthole NSFW Enabled 84
    bbwgw NSFW Enabled 61
    bbwhardcore NSFW Enabled 122
    bbwtits NSFW Enabled 134
    bdsm NSFW Enabled 242
    bdsm_smiles NSFW Enabled 137
    beamng Enabled 22
    beautifulfemales Enabled 182
    beefcurtains NSFW Enabled 161
    beer Enabled 12
    bestoflegaladvice Enabled 26
    bestofredditorupdates Enabled 127
    bicycletouring Enabled 14
    bigareolalover NSFW Enabled 140
    bigboobsgonewild NSFW Enabled 143
    bigdickgirl NSFW Enabled 246
    bigtittygothgf NSFW Enabled 319
    bikeporn Enabled 15
    blunderyears Enabled 25
    blursedimages Enabled 51
    bois NSFW Enabled 238
    brasil Enabled 38
    brownchickswhitedicks NSFW Enabled 287
    buildapcsales Enabled 81
    bustynaturals NSFW Enabled 520
    buttsandbarefeet NSFW Enabled 363
    castiron Enabled 14
    casualpt Enabled 15
    celebhub Enabled 162
    celebnsfw NSFW Enabled 186
    celebnudedebut NSFW Enabled 129
    celebritylegs Enabled 79
    celebs Enabled 138
    celebswithpetitetits Enabled 348
    cfb Enabled 16
    cfs Enabled 13
    chastitycouples NSFW Enabled 171
    chickflixxx NSFW Enabled 124
    chloe Enabled 23
    chubby NSFW Enabled 213
    chubby_hentai NSFW Enabled 82
    cirkeltrek Enabled 35
    citiesskylines Enabled 41
    citypop Enabled 17
    combatfootage Enabled 59
    comedyheaven Enabled 16
    comics Enabled 57
    comicstriphistory Enabled 14
    completeanarchy Enabled 21
    coolguides Enabled 141
    coronavirus Enabled 22
    couplesgonewildplus NSFW Enabled 104
    crackwatch Enabled 20
    creampie NSFW Enabled 216
    cremposting Enabled 18
    crossstitch Enabled 19
    cruelcaptions NSFW Enabled 52
    cryptocurrency Enabled 31
    cuckold NSFW Enabled 369
    cuckoldstories2 NSFW Enabled 81
    cumdumpsters NSFW Enabled 601
    cumshotgifs NSFW Enabled 279
    cumsluts NSFW Enabled 969
    curatedtumblr Enabled 17
    cursedcomments Enabled 48
    dankmemes Enabled 25
    daresgonewild NSFW Enabled 273
    datahoarder Enabled 57
    dataisbeautiful Enabled 153
    dccomics Enabled 18
    depthhub Enabled 11
    destiny2 Enabled 19
    diwhy Enabled 44
    documentaries Enabled 42
    dota2 Enabled 28
    dross NSFW Enabled 34
    drugscirclejerk Enabled 22
    emogirlsfuck NSFW Enabled 838
    enculerlesvoitures Enabled 13
    engineeringporn Enabled 79
    engorgedveinybreasts NSFW Enabled 276
    entertainment Enabled 26
    epicgamespc Enabled 22
    erotichypnosis NSFW Enabled 88
    eroticliterature NSFW Enabled 93
    exmormon Enabled 26
    extrafabulouscomics Enabled 19
    extramile NSFW Enabled 333
    eyebleach Enabled 48
    facepalm Enabled 25
    factorio Enabled 49
    fakealbumcovers Enabled 16
    fatwomenlove NSFW Enabled 73
    fedora Enabled 74
    feedthebeast Enabled 26
    femboy Enabled 93
    femboymemes Enabled 44
    femboys NSFW Enabled 272
    femboys4real NSFW Enabled 115
    feral_yiff NSFW Enabled 68
    feralpokeporn NSFW Enabled 84
    fixedgearbicycle Enabled 16
    flatchests NSFW Enabled 251
    food Enabled 18
    forgottenbookmarks Enabled 11
    formula1 Enabled 25
    formuladank Enabled 33
    fortcollins Enabled 13
    fortyfivefiftyfive NSFW Enabled 415
    fosscad Enabled 68
    fossdroid Enabled 142
    framework Enabled 28
    france Enabled 69
    freegamefindings Enabled 73
    frogbutt NSFW Enabled 280
    functionalprint Enabled 123
    funny Enabled 178
    furry_irl Enabled 133
    furryhits Enabled 10
    futadomworld NSFW Enabled 79
    fuzzypeeks NSFW Enabled 99
    gadgets Enabled 28
    gamedeals Enabled 150
    gamedealsfree Enabled 37
    games Enabled 71
    gamingleaksandrumours Enabled 30
    gay_irl Enabled 35
    gaytwerking NSFW Enabled 17
    genshin_impact Enabled 20
    gentlemanboners Enabled 276
    geocaching Enabled 17
    gfur NSFW Enabled 142
    gfurcomics NSFW Enabled 25
    ginger NSFW Enabled 272
    girlsfarting NSFW Enabled 25
    girlsfinishingthejob NSFW Enabled 786
    girlsjoy NSFW Enabled 281
    girlsmasturbating NSFW Enabled 631
    giscardpunk Enabled 12
    godot Enabled 16
    godpussy NSFW Enabled 680
    gonemildplus NSFW Enabled 46
    gonewild NSFW Enabled 689
    gonewild30plus NSFW Enabled 635
    gonewildaudio NSFW Enabled 384
    gonewildcolor NSFW Enabled 182
    gonewildhairy NSFW Enabled 155
    gonewildplus NSFW Enabled 90
    gonewildstories NSFW Enabled 412
    goodanimemes Enabled 76
    googleplaydeals Enabled 56
    gooned NSFW Enabled 414
    gravelcycling Enabled 21
    grimdank Enabled 27
    grool NSFW Enabled 282
    guildwars2 Enabled 37
    guiltygear Enabled 19
    hackernews Enabled 43
    hardware Enabled 18
    hentai NSFW Enabled 406
    hentaihumiliation NSFW Enabled 226
    hfy Enabled 32
    highstrangeness Enabled 64
    hmmm Enabled 15
    hobbydrama Enabled 14
    hockey Enabled 20
    hololive Enabled 23
    holup Enabled 48
    homeassistant Enabled 285
    homelab Enabled 143
    honkaistarrail Enabled 12
    horror Enabled 16
    hoyas Enabled 11
    humiliationcaptions NSFW Enabled 85
    humongousaurustits NSFW Enabled 174
    hyruleengineering Enabled 20
    icecreamery Enabled 13
    ich_iel Enabled 61
    imaginarybestof Enabled 33
    imaginarywarhammer Enabled 28
    impregnation NSFW Enabled 73
    imsorryjon Enabled 15
    imthemaincharacter Enabled 43
    inceltear Enabled 21
    incest_captions NSFW Enabled 332
    incestsexstories NSFW Enabled 168
    india Enabled 18
    interestingasfuck NSFW Enabled 52
    iphone Enabled 19
    itookapicture Enabled 126
    jailbreak Enabled 22
    japanese_adult_video NSFW Enabled 175
    japantravel Enabled 13
    jav NSFW Enabled 282
    javdreams NSFW Enabled 130
    kgbtr Enabled 10
    kinkycaptions NSFW Enabled 56
    koreannsfw NSFW Enabled 337
    kpopfap NSFW Enabled 82
    labiadangling NSFW Enabled 148
    ladyladyboners Enabled 137
    learnjapanese Enabled 24
    legalcatadvice Enabled 15
    leopardsatemyface Enabled 81
    lesbians NSFW Enabled 374
    lifehacks Enabled 19
    lifeprotips Enabled 82
    linustechtips Enabled 81
    linux_gaming Enabled 142
    livestreamfail Enabled 21
    loveforboozecruisers Enabled 12
    machinelearning Enabled 15
    mademesmile Enabled 53
    malelivingspace Enabled 38
    maliciouscompliance Enabled 41
    manga Enabled 35
    mapporn Enabled 149
    marchagainstnazis Enabled 18
    margotrobbie Enabled 16
    maybemaybemaybe Enabled 15
    mazda3 Enabled 10
    mcmansionhell Enabled 17
    me_irl Enabled 19
    mealtimevideos Enabled 11
    meirl Enabled 24
    meme Enabled 20
    memes Enabled 71
    merdasdoolx Enabled 12
    microsoft Enabled 13
    midjourney Enabled 16
    mildlyinteresting Enabled 132
    minecraft Enabled 12
    mmgirls NSFW Enabled 179
    modcoord Enabled 31
    monero Enabled 28
    monstermusume Enabled 15
    mortalkombat Enabled 16
    movieposterporn Enabled 23
    movies Enabled 45
    nadinejansen NSFW Enabled 23
    nanocurrency Enabled 18
    natalee NSFW Enabled 58
    nativeamericangirls2 NSFW Enabled 113
    nba Enabled 18
    neovim Enabled 11
    newzealand Enabled 48
    nexdock Enabled 13
    nextcloud Enabled 11
    nfa Enabled 14
    nfl Enabled 17
    nixos Enabled 22
    nordictrackandroid Enabled 14
    northkoreapics Enabled 14
    nosleep Enabled 99
    notkenm Enabled 15
    nsfw_caption NSFW Enabled 352
    nsfw_gif NSFW Enabled 516
    nsfw_japan NSFW Enabled 166
    nsfwcelebs NSFW Enabled 387
    nsfwcosplay NSFW Enabled 429
    nsfwcyoa NSFW Enabled 74
    nudecelebsonly NSFW Enabled 330
    oilporn NSFW Enabled 168
    okbuddyhololive Enabled 15
    okbuddyphd Enabled 14
    okbuddyretard Enabled 47
    onepiece Enabled 13
    onepunchman Enabled 37
    onguardforthee NSFW Enabled 13
    onmww NSFW Enabled 110
    onoffcelebs NSFW Enabled 166
    opensource Enabled 42
    opensourceapps Enabled 23
    orgasms NSFW Enabled 345
    osr Enabled 23
    paranormal Enabled 15
    pathofexile Enabled 10
    pcmasterrace Enabled 298
    peloton Enabled 31
    perth Enabled 14
    pillowtalkaudio NSFW Enabled 32
    piracy Enabled 126
    piracyarchive Enabled 24
    plussizedhotwives2 NSFW Enabled 77
    polandball Enabled 14
    politicalcompassmemes Enabled 30
    politicalhumor Enabled 17
    polska Enabled 35
    portugal Enabled 44
    portugalcaralho Enabled 23
    preggohentai NSFW Enabled 103
    presscumference NSFW Enabled 179
    prettygirls Enabled 190
    programminglanguages Enabled 15
    pronebone NSFW Enabled 204
    publicfreakout Enabled 81
    pussywallet NSFW Enabled 205
    quebec Enabled 15
    quilting Enabled 12
    rance Enabled 20
    rareinsults Enabled 56
    realcivilengineer Enabled 12
    redlettermedia Enabled 19
    redneckengineering Enabled 34
    retroussetits NSFW Enabled 353
    rg35xx Enabled 18
    riae_ NSFW Enabled 16
    riaesuicide NSFW Enabled 20
    roms Enabled 23
    rule34 NSFW Enabled 757
    rust Enabled 16
    samsungdex Enabled 23
    sbcgaming Enabled 26
    science Enabled 71
    sdnsfw NSFW Enabled 408
    selfhosted Enabled 169
    sffpc Enabled 42
    sfwredheads Enabled 112
    sharktits NSFW Enabled 24
    shecame NSFW Enabled 148
    shefuckshim NSFW Enabled 694
    shibbysays NSFW Enabled 82
    shitposting Enabled 15
    shorthairchicks NSFW Enabled 291
    shorthairedwaifus Enabled 64
    simpsonsshitposting Enabled 93
    singularity Enabled 45
    sissyinspiration NSFW Enabled 164
    slimthick NSFW Enabled 398
    slink NSFW Enabled 25
    slutoon NSFW Enabled 39
    sluttyconfessions NSFW Enabled 300
    smallboobs NSFW Enabled 553
    soccer Enabled 22
    sonicporn NSFW Enabled 16
    sonicthehedgehog Enabled 29
    space Enabled 59
    spanking NSFW Enabled 62
    specializedtools Enabled 18
    speedrun Enabled 22
    spicykittens Enabled 11
    squaredcircle Enabled 21
    stablediffusion Enabled 50
    steamdeals Enabled 146
    steamdeck Enabled 187
    stevenuniverse Enabled 16
    strapon NSFW Enabled 204
    stuffers NSFW Enabled 28
    submechanophobia Enabled 24
    suctiondildos NSFW Enabled 146
    swtor Enabled 17
    taboocaptions NSFW Enabled 272
    talesfromretail Enabled 13
    talesfromtechsupport Enabled 28
    tasker Enabled 21
    tech Enabled 32
    technicallythetruth Enabled 39
    technology Enabled 110
    techsupportgore Enabled 15
    telegrambots Enabled 14
    television Enabled 43
    tentai NSFW Enabled 229
    teslamotors Enabled 17
    tf_irl Enabled 21
    thalassophobia Enabled 12
    thedeprogram Enabled 106
    thegrandtour Enabled 17
    thenetherlands Enabled 27
    therewasanattempt Enabled 31
    therian Enabled 12
    theyknew Enabled 26
    thick NSFW Enabled 308
    thomastheplankengine Enabled 15
    threesome NSFW Enabled 172
    tifu Enabled 130
    tihi Enabled 11
    tiktokchallenge NSFW Enabled 82
    tiktokthots NSFW Enabled 264
    todayilearned Enabled 510
    transformation NSFW Enabled 70
    traps NSFW Enabled 326
    truespotify Enabled 15
    truscum Enabled 19
    tucson Enabled 21
    tvplus Enabled 13
    twinks NSFW Enabled 147
    u_icky_peach NSFW Enabled 13
    ufo Enabled 10
    ufos Enabled 47
    ukraine Enabled 62
    ukrainewarvideoreport Enabled 30
    ukrainianconflict Enabled 113
    unbgbbiivchidctiicbg Enabled 56
    undertoys NSFW Enabled 101
    unexpected Enabled 38
    unixporn Enabled 57
    unixsocks Enabled 12
    upliftingnews Enabled 79
    vegetablegardening Enabled 23
    videos Enabled 18
    vore NSFW Enabled 18
    washingtondc Enabled 10
    watchitfortheplot NSFW Enabled 274
    weightlifting Enabled 16
    wetpussys NSFW Enabled 551
    wholesomeyuri Enabled 77
    widaczabory Enabled 2
    woodworking Enabled 14
    worldnews Enabled 303
    wow Enabled 15
    wrx Enabled 13
    wtf Enabled 18
    yiff NSFW Enabled 209
    yiffcomics NSFW Enabled 70
    yuri NSFW Enabled 94
    yuri_jp Enabled 29
    zeldass NSFW Enabled 105
    zillowgonewild Enabled 14
    submitted 3 years ago* (last edited 2 years ago) by [M] to c/about@lemmit.online
     

    In the short time since this instance and bot launched, I've been seeing the same questions resurface multiple times. This is totally understandable, since the concept of a Fediverse is still new to most (myself included), and this server is not like the others.

    Q: What is Lemmit?

    A: Lemmit is a Lemmy instance specifically designed for archiving Reddit content. Users can request new subreddits to be included in the archiving process by posting in the !requests@lemmit.online community. It is powered by an open source python bot, which periodically checks the request list, adds new requests to the queue, and continuously monitors the Hot feed of those subs for new posts to cross-post here.

    Q: Does it synchronize comments?

    A: No, that would be impossible. Considering there are thousands of posts already on Lemmit, many of them having at least several hundred comments on Reddit, often buried in deep layers, it simply wouldn't be feasible to index those for more than a few posts, let alone keep them up to date.

    Unfortunately, this means that archiving certain subreddits, such as Ask Historians/Men/Women/Hyperintelligentshadesofthecolourblue-type subs, is going to be rather pointless.

    Q: Can it send comments back to Reddit?

    A: No, it cannot. The purpose is to help bootstrap the Lemmy platform, not to serve as a bridge between the two networks. Also, see the answer about synchronizing comments.

    Q: Can I request any subreddit?

    A: Technically, yes. However, as the list of subs grows, the time it takes to update all of them will also increase. I do not have strict guidelines in place for this, so I'm relying on your common sense (hoooo boy). At some point, I will probably have to either stop accepting new requests or disable scraping for very low-traffic communities. Nope. Automatic requests for new subreddits are closed. You can send me a PM if you think a specific subreddit would be a valuable addition to the Lemmyverse, but you'll have to make a strong case.

    Q: Does this use the API? Will it keep working after July 1st?

    A: Nope, it uses a combination of the public feed and scraping old.reddit.com. So, as long as those are still available, it will continue working. And even if they close those sources, there will probably be new ways to achieve the same effect. "Content, eh, finds a way."

    Q: This is spam, can you stop?

    A: First of all, I apologise for the inconvenience. All you have to do is block @bot@lemmit.online, and none of its posts will ever show up on your instance. If you you don't want anyone else on your server to be exposed to this bot/instance, you should convince your admin to defederate from lemmit.online. Since there are no other users on here, there will be no harm done.

    Obviously I could stop, because running this server and software is only ever going to cost me time and money. But for the reasons listed above, I still think this server is a useful addition to the lemmyverse at this time. But I'm looking forward to the day where I can turn the bot off because it's no longer needed.

    Q: What started this?

    A: Okay, nobody asked this, but I'm going to tell you anyway. After Reddit made it clear that they are effectively killing third-party apps and implementing plenty of other anti-end user decisions, I realized that I would either have to accept not being able to access my time-wasting content or have to do so in a rather uncomfortable way (either through the official app or old.reddit.com for as long as they'll allow it to exist).

    Being a stubborn developer, naturally, I chose option C: Have my own Reddit. With blackjack, and hookers. This way, I would still be able to access my beloved content without being beholden to Reddit's mood swings and abusive relationship tendencies.

    Besides that, I also know that Content is King. So I'm order to counter the network effect (No users because no content, No content because no users), I figured it would be better to have some inorganic content to bootstrap the adoption of Lemmy.

    Q: Are NSFW subreddits allowed?

    A: Absolutely. Like I said: Blackjack and hookers.

    Q: My request isn't picked up by the bot!

    A: That isn't a question. But yeah, the process isn't flawless yet. I'm trying to iron out all the bugs as I encounter them. In the meantime, feel free to re-request the subreddit by making a second post. No harm done. New subreddit requests are closed for the time being.

    Q: No new posts are showing up at all on Lemmit

    A: If no posts are appearing on the Lemmit Frontpage (sorted by NEW), it's possible that the bot has crashed or is stuck on something. Since no software is flawless, this sometimes happens. I usually fix this as soon as I'm aware, and I'm happy to say that these kinds of fatal errors are becoming less and less frequent. However, they may still occur, and as a human with needs of sleep and other responsibilities, I'm not always able to fix them immediately.

    Q: Posts aren't showing up on my instance, what's up?

    A: Due to the spammy nature of the bot, some server admins choose to block this server, and that is completely understandable. So first of all, make sure to check the instances link in the footer of your home server. If Lemmit is the Blocked Instances list, you're out of luck.

    When you have verified that Lemmit is not blocked on your instance, try unsubscribing, waiting a little, and then re-subscribing. That tends to fix things.

     

    I have created some software that is capable of synchronising posts from Reddit to Lemmy. It's still a little rough around the edges, but it works as a such:

    People can request new subreddits to be mirrored on !requests@lemmit.online. A bot (open source) will monitor the threads there, and if it finds a new request for a subreddit, it will make a new community on the Lemmit server, and add it to its monitored list. It will then make periodic checks to see if any new posts (it doesn't copy any comments) have been posted on reddit, and copy those over.

    Users can then subscribe to those communities from their own lemmy instance, and from there federation will pick it up. Or at least, that's the theory. At the moment, federation is not working awesomely, and that is where my lack of fediverse knowledge comes in. Maybe it needs more time, or something is not so properly - I don't know.

    Furthermore: registrations on this server are closed. The point of this service is not to become a community on its own, but to deliver, ehh, "original" content to all the rest of the Fediverse while it's going through a ramp-up phase. Besides, the instance is running on a pretty small vps, and I rather have this thing manage itself. There is a !about@lemmit.online community for further questions about the project itself though, in case people want to discuss it further.

    So ehm... Let me know what you think :)