1. DLP Flash Christmas Competition + Writing Marathon 2024!

    Competition topic: Magical New Year!

    Marathon goal? Crank out words!

    Check the marathon thread or competition thread for details.

    Dismiss Notice

  2. Hi there, Guest

    Only registered users can really experience what DLP has to offer. Many forums are only accessible if you have an account. Why don't you register?
    Dismiss Notice
  3. Introducing for your Perusing Pleasure

    New Thread Thursday
    +
    Shit Post Sunday

    READ ME
    Dismiss Notice
DLP Story Competition Guest User Registration Nag SPS + NTT

Scryer - DLP's FF Search Engine

Discussion in 'General Discussion' started by Lord Ravenclaw, Mar 31, 2016.

4.3333334922791/5, 6 votes
Page 10 of 11
  1. Nuit

    Nuit Dark Lord

    Joined:
    Feb 14, 2010
    Messages:
    1,934
    Location:
    The Peach State
    Sep 30, 2019 #181
    I'd like to request Warcraft be added.
     
  2. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Oct 2, 2019 #182
    Added. Check back in an hour or two and it should be indexed.
     
    Iztiak, Nuit, Oz
  3. Snarf

    Snarf Squanchin' Party Bro! ~ Prestige ~ DLP Supporter

    Joined:
    Apr 27, 2007
    Messages:
    18
    Gender:
    Male
    Location:
    Forty-Six & 2
    High Score:
    1,832
    Nov 10, 2019 #183
    All searches are no longer populating new content from about 16 hours ago.
     
  4. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Nov 10, 2019 #184
    Every night, 1/30th of all indexed fandoms are selected for complete reindexing. When HP is reindexed, it tends to take a while at the slow pace I allow the crawler to make requests. That completed about an hour after your post and the hourly delta fetches resumed.
     
    Snarf, Zombie
  5. dmacx

    dmacx Groundskeeper

    Joined:
    Jun 29, 2008
    Messages:
    375
    Mar 16, 2020 #185
    Is there a way to exclude certain fandoms when searching for crossovers?
     
  6. Zombie

    Zombie Black Philip Moderator DLP Supporter ⭐

    Joined:
    Apr 28, 2007
    Messages:
    6,036
    Mar 16, 2020 #186
    I thought you had to specify the crossover fandom A/B so how is the fandom you want to be excluded being included?
     
  7. dmacx

    dmacx Groundskeeper

    Joined:
    Jun 29, 2008
    Messages:
    375
    Mar 16, 2020 #187
    The way it is now, let's say I select Mass Effect on the left side. On the right, I can select individual fandoms to include, or (all fandoms). What I'd like to be able to do is specify multiple fandoms on the right side that I don't want. I'm not seeing a way to do that.
     
  8. Zombie

    Zombie Black Philip Moderator DLP Supporter ⭐

    Joined:
    Apr 28, 2007
    Messages:
    6,036
    Mar 16, 2020 #188
    Wouldn't they be excluded if they're not included? I'll let Raven weigh in more on that, but that's how I interpreted that function to work.
     
  9. lopeck

    lopeck Groundskeeper

    Joined:
    Oct 22, 2013
    Messages:
    334
    Gender:
    Male
    Location:
    Germany
    Mar 16, 2020 #189
    Yes, but if you want to see all crossovers except a with a specific few fandoms you are currently screwed.
    If you, for example, want to exclude Naruto and Avengers from the crossover list, you can't just toggle exclude and add those two. You have to manually add all others. In the case of Harry Potter that would be over 800.

    Obviously most other fandoms have a far smaller list of crossovers, but the option to exclude would still remove a lot of hassle in such edge cases.
     
    dmacx
  10. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Mar 17, 2020 #190
    Adding an "exclude" toggle wouldn't be hard, I'll see what I can do.
     
    Ched, lopeck, dmacx, FridgeViking, Sauce Bauss
  11. dmacx

    dmacx Groundskeeper

    Joined:
    Jun 29, 2008
    Messages:
    375
    Mar 18, 2020 #191
    You said it far better than I did.

    Thank you. This would make an already good tool even better.
     
  12. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Apr 15, 2020 #192
    I haven't forgotten the request above, I have some work in progress there. :)

    I did want to announce that I've made a dark mode for Scryer. It's not 100%, and I'll be tweaking it as I go, but it's now available. Just click the icon next to "Queue" to enable.

    Screen Shot 2020-04-14 at 21.16.28.png
     
    Leo1980s, Newcomb, Ched, Rahkesh Asmodaeus, Sauce Bauss, Microwave
  13. muthulx

    muthulx Muggle

    Joined:
    Oct 27, 2018
    Messages:
    4
    Location:
    United States
    Apr 17, 2020 #193
    Would it be too difficult to add another Fandom? If not, Can "prince of tennis" be added?
    Thanks in advance!
     
  14. Silirt

    Silirt Chief Warlock DLP Supporter ⭐⭐

    Joined:
    Sep 19, 2018
    Messages:
    1,537
    Gender:
    Male
    Location:
    Georgia
    Apr 17, 2020 #194
    I was about to make a joke but fuck, looks like you've got something there. What's weird is it appears in the crossover fuzzy search.
    upload_2020-4-17_1-18-39.png
     
    oakgem217
  15. muthulx

    muthulx Muggle

    Joined:
    Oct 27, 2018
    Messages:
    4
    Location:
    United States
    Apr 17, 2020 #195
    I usually make do with this Firefox Addon, it adds some filtering on top of the archaic ffnet's filtering.
    https://addons.mozilla.org/en-US/firefox/addon/fanfiction-tools/
    It's pretty good for many purposes like avoiding certain keywords but prince of tennis fandom is pretty huge, and scryer is way more advanced than all of these tools.. I did notice this fandom in crossover search.. Could it be because of HP fandom indexing? ..as prince of tennis's most popular crossovers are Harry Potter and Inuyasha.
    (It's just sad there are very few ffnet scraper tools out there when AO3 has so many :
    https://github.com/search?q=ao3
    as an aside as a very basic python programmer , I find many of this very interesting)
     
  16. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Apr 17, 2020 #196
    Scryer indexes a certain list of fandoms, when it does it indexes all of that fandom's crossovers with at least 3 stories. So you'll see crossover fandoms which aren't actually indexed themselves. I consider those a part of the "source fandom".

    I've added "Prince of Tennis" to the list of indexed "source" fandoms. Depending on whether I managed to get the database update in before the indexer starts, it'll show up in an hour or two.
     
    Ched
  17. muthulx

    muthulx Muggle

    Joined:
    Oct 27, 2018
    Messages:
    4
    Location:
    United States
    Apr 17, 2020 #197
    Thanks a lot!
     
  18. Lord Ravenclaw

    Lord Ravenclaw DLP Overlord Admin DLP Supporter

    Joined:
    Apr 2, 2005
    Messages:
    4,372
    Location:
    Denver, CO
    Apr 19, 2020 #198
    It's done, though honestly there's some kind of nasty edge cases around character loading that I need to work out. Loading all characters across all fandoms is apparently (for Rails) fairly expensive, and Chosen (frontend UI) is also poorly optimized for long lists of items. It comes grinding to a halt after every crossover addition for big fandoms.

    I have a good way to improve that situation, but until then it'll be a little annoying to use. There also might be bugs -- if you find any, let me know. :)

    Capture2.PNG
     
    FridgeViking, Ched, Microwave, lopeck, Alindrome, Sauce Bauss
  19. Henry Persico

    Henry Persico Groundskeeper DLP Supporter

    Joined:
    Sep 13, 2011
    Messages:
    343
    Location:
    Argentina
    Nov 6, 2020 #199
    Hi guys, there seems to be an issue when searching stories, the last update is from 5 days ago. Thanks.
     
  20. Oz

    Oz For Zombie. Moderator DLP Supporter

    Joined:
    Jan 31, 2008
    Messages:
    9,027
    Gender:
    Female
    Location:
    Baile Átha Cliath
    Nov 6, 2020 #200
    FFN has been having issues no?
     
Page 10 of 11
Loading...
Similar Threads
  1. HarrySeverusPotter

    DLP's highest rated top ten fics.

    HarrySeverusPotter, Aug 2, 2016, in forum: General Discussion
    Replies:
    8
    Views:
    4,527
    Dark Minion
    Aug 4, 2016
  2. Alindrome

    How to Join DLP's IRC

    Alindrome, May 6, 2016, in forum: General Discussion
    Replies:
    3
    Views:
    10,659
    Sauce Bauss
    Aug 13, 2017
  3. eXcalite

    DLP's History

    eXcalite, Aug 30, 2008, in forum: General Discussion
    Replies:
    107
    Views:
    24,333
    Mage
    Oct 8, 2008
  4. the-caitiff

    Graffiti for DLP's Dark Mark

    the-caitiff, Jul 16, 2007, in forum: General Discussion
    Replies:
    16
    Views:
    8,620
    Lecter
    Jul 17, 2007