SmokeyDope
- 2 Posts
- 7 Comments
SmokeyDope@piefed.socialto
Selfhosted@lemmy.world•What steps can be taken to prevent AI training and scraping of my public facing website?English
11·4 months agoAnubis is your friend
SmokeyDope@piefed.socialOPto
Selfhosted@lemmy.world•Anubis is awesome and I want to talk about itEnglish
1·4 months agoSomething that hasn’t been mentioned much in discussions about Anubis is that it has a graded tier system of how sketchy a client is and changing the kind of challenge based on a a weighted priority system.
The default bot policies it comes with has it so squeaky clean regular clients are passed through, then only slightly weighted clients/IPs get the metarefresh, then its when you get to moderate-suspicion level that JavaScript Proof of Work kicks. The bot policy and weight triggers for these levels, challenge action, and duration of clients validity are all configurable.
It seems to me that the sites who heavy hand the proof of work for every client with validity that only last every 5 minutes are the ones who are giving Anubis a bad wrap. The default bot policy settings Anubis comes with dont trigger PoW on the regular Firefox android clients ive tried including hardened ironfox. meanwhile other sites show the finger wag every connection no matter what.
Its understandable why some choose strict policies but they give the impression this is the only way it should be done which Is overkill. I’m glad theres config options to mitigate impact normal user experience.
SmokeyDope@piefed.socialOPto
Selfhosted@lemmy.world•Anubis is awesome and I want to talk about itEnglish
4·4 months agoTheres a compute option that doesnt require javascript. The responsibility lays on site owners to properly configure IMO, though you can make the argument its not default I guess.
https://anubis.techaro.lol/docs/admin/configuration/challenges/metarefresh
From docs on Meta Refresh Method
Meta Refresh (No JavaScript)
The
metarefreshchallenge sends a browser a much simpler challenge that makes it refresh the page after a set period of time. This enables clients to pass challenges without executing JavaScript.To use it in your Anubis configuration:
# Generic catchall rule - name: generic-browser user_agent_regex: >- Mozilla|Opera action: CHALLENGE challenge: difficulty: 1 # Number of seconds to wait before refreshing the page algorithm: metarefresh # Specify a non-JS challenge methodThis is not enabled by default while this method is tested and its false positive rate is ascertained. Many modern scrapers use headless Google Chrome, so this will have a much higher false positive rate.
As a bonus their mom briefly became socialist when she freely shared some crabs and HIV with you :)
SmokeyDope@piefed.socialto
memes@lemmy.world•Maybe they needed to cook a bit longer..English
8·5 months agoEither my reference wasn’t clear enough or the trailer park boys has seriously faded in cultural relevance.

SmokeyDope@piefed.socialto
memes@lemmy.world•Maybe they needed to cook a bit longer..English
9·5 months agoThis is from the scene where Ricky graditated from the eighth grade right?


I stepped up my nerd game to start trying to land an IT job of some kind. I learned computer networking to set up my own website on recycled hardware and began writing about it. I started developing on a game engine making modules and making art assets to maybe one day make a commercial product. I released like a dozen open source projects under open source licenses.
It all kind of culminated with Christmas. The kids in my life have been begging for multiplayer Minecraft server but Microsoft destroyed the he so hard with money grabbing we refused to pay for realms or make a bunch of Microsoft accounts or whatever.
So, I rolled up my sleeves and got to work on creating a mineclonia server built on luanti/minetest engine, patching in all the Minecraft assets like textures, sounds, music that I legally own with python tools I built myself and released,
I really wanted an in game fullscreen map and nobody had ever figured out how to make one on luanti engine so I so spent a few weeks developing one from the ground up. I released the map mod two days ago and people quickly noticed saying I had changed the game forever, congratulating me on my technological achievement or whatever.
Its just a little frustrating because it feels like I’m somewhat competent at the nerd professions but I have no idea how to advertise my talents or if what I’m doing even translates to real Dev work. How Does creating universal map colorizer + generator for proceeduraly generated voxel worlds or designing a full model animation interpolation system for an engine from scratch or hosting public services on my own network built from scratch powered by solar turn into resume stuffs? That’d what I guess new years focus needs to be