1. DLP Flash Christmas Competition + Writing Marathon 2024!

    Competition topic: Magical New Year!

    Marathon goal? Crank out words!

    Check the marathon thread or competition thread for details.

    Dismiss Notice
  2. Hi there, Guest

    Only registered users can really experience what DLP has to offer. Many forums are only accessible if you have an account. Why don't you register?
    Dismiss Notice
  3. Introducing for your Perusing Pleasure

    New Thread Thursday
    +
    Shit Post Sunday

    READ ME
    Dismiss Notice

Scryer - DLP's FF Search Engine

Discussion in 'General Discussion' started by Lord Ravenclaw, Mar 31, 2016.

  1. Sesc

    Sesc Slytherin at Heart Moderator

    Joined:
    Dec 20, 2007
    Messages:
    6,216
    Gender:
    Male
    Location:
    Blocksberg, Germany
    Yes. Scryer is working fine, FF.net is not.


    I also want to take the time to point out the newly-added min-avg filter:

    upload_2020-11-7_5-7-25.png

    It removes nonsense like this:

    upload_2020-11-7_5-9-22.png

    Thank @Lord Ravenclaw for doing his magic :wizard:
     
  2. Harpo the Fool

    Harpo the Fool Fourth Year

    Joined:
    Oct 30, 2022
    Messages:
    139
    I hope this isn't dinged as necroposting but ff2ebooks has a 55GB compressed torrent of an old ffnet scrape that they did in 2021(?). I downloaded it a while ago and ran it through some scripts to extract the metadata. I don't know whether Scryer has that stuff already. If not, I'm happy to contribute it. The metadata dump basically has the FFN headers including the summaries. It is around 200MB of text, 35MB compressed. I don't remember how much of it is Harry Potter vs other fandoms. A very rough check indicates about 25% Potter. Just PM me if you want it.
     
  3. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Appreciate it, but the value of the Scryer index is freshness and ongoing index maintenance.
     
Loading...