Dark Lord Potter Forums
Go Back   Dark Lord Potter Forums > Common Room > General Discussion
Donate Register Rules Library List IRC Chat FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read

Notices

Donate to DLP Scryer Banner

 
Thread Tools Display Modes
Old 03-31-2016, 02:41 PM   #1
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Scryer - DLP's FF Search Engine

Hey gang,

Scryer is DLP's Fanfiction Search Engine. It provides an alternative search engine on top of FFN (and eventually other sites). It's been around a while, but it's probably about time I make a thread. As far as I know, it's the only currently active alternate search engine for FFN.

This thread is for feedback, feature requests, and other commentary. Not all feature requests can or will be implemented.

If Scryer has planned or unplanned downtime, this thread will be updated accordingly.

Current features
  • Full-text search over titles, authors, and summaries
  • Multi-fandom and crossover support
  • Integrates with DLP ratings
  • Unique sortings, e.g. popular & recently updated
  • Precise filters and drilldown, e.g. to find long one-shots or all stories between 50k and a 100k words
  • Search sharing [alpha]
  • Saved searches [alpha]
  • Gender discrimination, e.g. a slash filter [alpha]

Planned features
  • Inferred relationships from summary when not provided, common with older fics
  • AO3 search
  • Pensieve: Chrome extension to track your reading, help recommend stories to you.
  • Filtering by time to read, based on how long it's taken you to read stories in the past. Based on the Pensieve.
  • Showing new updates of stories recently read, also based on the Pensieve.
  • FFN favorite import as saved searches / recommendations.
  • DLP-integrated ratings embedded into FFN
  • Mark read stories to avoid needing to re-read.
  • Show read stories after update.

Known issues
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 03-31-2016, 03:02 PM   #2
NuitTombee
Supreme Mugwump
 
NuitTombee's Avatar
 
Join Date: Feb 2010
Location: The Peach State
Gender: Male
Posts: 1,698
For some reason, when I manually scroll through the drop-down menus it wants to stay at the bottom of the list.

In both Chrome and Firefox.

You can overcome it in the Categories drop-down but the Characters list is too long and you can't scroll up far enough so it just keeps dropping to the bottom.
__________________

Last edited by NuitTombee; 03-31-2016 at 03:05 PM.
NuitTombee is offline   Reply With Quote
Old 03-31-2016, 03:10 PM   #3
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Quote:
Originally Posted by NuitTombee View Post
For some reason, when I manually scroll through the drop-down menus it wants to stay at the bottom of the list.

In both Chrome and Firefox.

You can overcome it in the Categories drop-down but the Characters list is too long and you can't scroll up far enough so it just keeps dropping to the bottom.
Works for me on latest Chrome (and many earlier versions). Can you take a screenshot to try and show me what you mean?

Quote:
Originally Posted by Ankan View Post
When I'm browsing with crossovers, some names might not be shown in alphabetical order. Because of that, it's a pain to browse crossovers using my phone where I can't just write the name.
Yep -- it's a PITA on mobile, I'm working on fixing that now. I put this in Known Issues for now.
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 03-31-2016, 03:09 PM   #4
Ankan
Groundskeeper
 
Ankan's Avatar
 
Join Date: Feb 2014
Location: Northern Sweden
Gender: Male
Posts: 329
When I'm browsing with crossovers, some names might not be shown in alphabetical order. Because of that, it's a pain to browse crossovers using my phone where I can't just write the name.
__________________
Quote:
Originally Posted by Prophet Medivh, Arthas: Rise of the Lich King
The prophet smiled now, sadly. “It is not only with our eyes that we see, Prince Arthas. It is with our wisdom and our hearts. I will leave you with one final prediction. Just remember, the harder you strive to slay your enemies, the faster you’ll deliver your people into their hands.”
Ankan is offline   Reply With Quote
Old 03-31-2016, 03:23 PM   #5
NuitTombee
Supreme Mugwump
 
NuitTombee's Avatar
 
Join Date: Feb 2010
Location: The Peach State
Gender: Male
Posts: 1,698
It may be my outdated OS, I'll try it on my Win 8.1 laptop in a second. Here's it in action:



Edit: Does the same thing in Win 8.1 Chrome and Firefox.
__________________

Last edited by NuitTombee; 03-31-2016 at 03:46 PM.
NuitTombee is offline   Reply With Quote
Old 03-31-2016, 03:27 PM   #6
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Quote:
Originally Posted by NuitTombee View Post
It may be my outdated OS, I'll try it on my Win 10 laptop in a second. Here's it in action:
I don't have access to Win10 today, but this weekend I'll give it a shot on Windows and try to get that fixed. For now, you can type what you're looking for and hit enter.
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 04-12-2016, 12:53 AM   #7
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
New release of Scryer tonight. Bugfixes + some backend work to prepare for shared search. Fairly minor frontend enhancements:
  • Stories sort by their DLP review score
  • Characters are properly sorted
  • With multiple fandoms, characters are disambiguated by fandom name
  • Select boxes were always sorting to the bottom, this was a problem with bundled jQuery 1.12.0, resolved by upgrading.

Please check the list of known issues. If it's inaccurate, let me know!

Quote:
Originally Posted by NuitTombee View Post
It may be my outdated OS, I'll try it on my Win 8.1 laptop in a second. Here's it in action:

Edit: Does the same thing in Win 8.1 Chrome and Firefox.
@NuitTombee This was fixed with tonight's release.
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 03-31-2016, 03:30 PM   #8
NuitTombee
Supreme Mugwump
 
NuitTombee's Avatar
 
Join Date: Feb 2010
Location: The Peach State
Gender: Male
Posts: 1,698
I know, just reporting any errors I find.

Edit: My mistake, the laptop is Windows 8.1.
__________________

Last edited by NuitTombee; 03-31-2016 at 03:46 PM.
NuitTombee is offline   Reply With Quote
Old 03-31-2016, 03:50 PM   #9
MoltenCheese
Seventh Year
 
MoltenCheese's Avatar
 
Join Date: Jul 2015
Location: The Plastic Country
Gender: Male
Posts: 284
I've just checked Scryer a bit, and it seems that sorting by "DLP Review Score" isn't working properly. The order of highest/lowest scores are all messed up.

Example
__________________
“Poets have been mysteriously silent on the subject of cheese.”
MoltenCheese is offline   Reply With Quote
Old 04-14-2016, 04:49 PM   #10
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Another release. All backend, but you'll like it.
  • Scryer now knows about *all* FFN fandoms and what "categories" they belong in, e.g. book/tv/movies/plays(?). This makes the next feature possible.
  • Crawler infrastructure upgraded to allow for simple addition of new fandoms. Most reasonably-sized fandoms can be ingested within 30 minutes with only a simple database toggle.
  • New fandoms added: Alex Rider, Hikaru no Go + filling out the Sci-Fi portfolio with the missing Star Trek/Stargate/StarWars fandoms. You're welcome. Edit: And Pokemon.

New fandoms can be added on request (at my discretion). This is the appropriate thread to request them now that it's easy to do so.
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 04-14-2016, 05:01 PM   #11
MoltenCheese
Seventh Year
 
MoltenCheese's Avatar
 
Join Date: Jul 2015
Location: The Plastic Country
Gender: Male
Posts: 284
Is it possible for the Pokemon fandom to be added as well? I feel like being able to remove words like betrayed, Arceus, pokephilia, harem, aura, etc would really help me find some decent Pokemon fics that are buried under the plethora of bad stories.
__________________
“Poets have been mysteriously silent on the subject of cheese.”
MoltenCheese is offline   Reply With Quote
Old 04-14-2016, 05:36 PM   #12
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Quote:
Originally Posted by MoltenCheese View Post
Is it possible for the Pokemon fandom to be added as well? I feel like being able to remove words like betrayed, Arceus, pokephilia, harem, aura, etc would really help me find some decent Pokemon fics that are buried under the plethora of bad stories.
It's backfilling now. It'll show up some time in the next 20-40 minutes.
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Thumbs Up 3 thumbs up
Old 04-15-2016, 12:17 AM   #13
Reign
Fourth Year
 
Reign's Avatar
 
Join Date: Oct 2008
Gender: Male
Posts: 117
The github link doesn't work. I'm guessing its no longer an open project?
Reign is offline   Reply With Quote
Old 04-15-2016, 10:43 AM   #14
Lord Ravenclaw
Administrator
System God
 
Lord Ravenclaw's Avatar
 
Join Date: Apr 2005
Location: Denver, CO
Gender: Male
Posts: 4,100
Quote:
Originally Posted by Reign View Post
The github link doesn't work. I'm guessing its no longer an open project?
https://gitlab.com/projectdlp/scryer/
__________________
Scryer - FF Search Engine
Lord Ravenclaw is offline   Reply With Quote
Old 04-24-2016, 03:30 PM   #15
Researcher
First Year
 
Join Date: Oct 2015
Location: Sweden
Age: 21
Gender: Male
Posts: 49
Feature request:
  • Be able to narrow down things to a timespan. E.g. "Updated between {date} and {date}", "Published between {date} and {date}", etc.
  • Specify (average) minimum words per chapter.
Researcher is offline   Reply With Quote
Old 04-24-2016, 03:34 PM   #16
Peter North
Supreme Mugwump
 
Peter North's Avatar
 
Join Date: Jul 2013
Location: New Hampshire
Gender: Male
Posts: 1,772
Quote:
Originally Posted by Unspeakable Merlin View Post
Feature request:
  • Be able to narrow down things to a timespan. E.g. "Updated between {date} and {date}", "Published between {date} and {date}", etc.
  • Specify (average) minimum words per chapter.
I'm pretty sure you can already do all of that.

Word cound min to max
Chapters min to max
And sort by update and publish date

https://scryer.darklordpotter.net/

I think you should scroll down the page more to see these features.
__________________
Yer a wizard 'arry. First we'll get yeh wand and then they'll be the sortin' - Good fun, tha'. Then it's off to Liberia to transfigure Ebola-stained bedsheets into treacle tart... Ohh shouldna told yeh that. Should NOT have told yeh that. ~ Vlad
Peter North is offline   Reply With Quote
Old 04-24-2016, 03:57 PM   #17
Ankan
Groundskeeper
 
Ankan's Avatar
 
Join Date: Feb 2014
Location: Northern Sweden
Gender: Male
Posts: 329
Quote:
Originally Posted by Peter North View Post
I'm pretty sure you can already do all of that.

Word cound min to max
Chapters min to max
And sort by update and publish date

https://scryer.darklordpotter.net/

I think you should scroll down the page more to see these features.
He means to sort within a specific date not just sort by date. An example is to only view fics between 1st April 2013 to 1st of April 2014
__________________
Quote:
Originally Posted by Prophet Medivh, Arthas: Rise of the Lich King
The prophet smiled now, sadly. “It is not only with our eyes that we see, Prince Arthas. It is with our wisdom and our hearts. I will leave you with one final prediction. Just remember, the harder you strive to slay your enemies, the faster you’ll deliver your people into their hands.”
Ankan is offline   Reply With Quote
Old 04-24-2016, 06:11 PM   #18
Researcher
First Year
 
Join Date: Oct 2015
Location: Sweden
Age: 21
Gender: Male
Posts: 49
Quote:
Originally Posted by Peter North View Post
[...]
Word cound min to max
Chapters min to max
[---]
You misunderstand me; I want to be able to set an minimum chapter length, independent of the total length.

If I already can do that, could you please explain to me how I should fill out the fields to only get stories with a minimum of 5,000 words/chapter, and a minimum of 25,000 words total?
Researcher is offline   Reply With Quote
Old 04-24-2016, 06:18 PM   #19
Peter North
Supreme Mugwump
 
Peter North's Avatar
 
Join Date: Jul 2013
Location: New Hampshire
Gender: Male
Posts: 1,772
Quote:
Originally Posted by Unspeakable Merlin View Post
You misunderstand me; I want to be able to set an minimum chapter length, independent of the total length.

If I already can do that, could you please explain to me how I should fill out the fields to only get stories with a minimum of 5,000 words/chapter, and a minimum of 25,000 words total?
Right here
__________________
Yer a wizard 'arry. First we'll get yeh wand and then they'll be the sortin' - Good fun, tha'. Then it's off to Liberia to transfigure Ebola-stained bedsheets into treacle tart... Ohh shouldna told yeh that. Should NOT have told yeh that. ~ Vlad
Peter North is offline   Reply With Quote
Old 04-24-2016, 06:32 PM   #20
NuitTombee
Supreme Mugwump
 
NuitTombee's Avatar
 
Join Date: Feb 2010
Location: The Peach State
Gender: Male
Posts: 1,698
Quote:
Originally Posted by Peter North View Post
To my knowledge, Wordcount pertains to total words in the story and Chapters is the number of chapters in the story; not the amount of words in each chapter.
__________________
NuitTombee is offline   Reply With Quote


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Resolved] Scryer Down? moonpotato Site Related Support 7 01-22-2016 01:27 PM
Scryer: Fanfiction Search Database (Alpha) Lord Ravenclaw Announcements 109 04-26-2015 11:22 PM
FanFiction Search Engine broken ? samkar FanFic Discussion 21 04-12-2011 07:11 PM
Techblog: Sphinx Search: MySQL Fulltext Search Engine Replacement PatronusCharm FeedBot Techblog 0 07-21-2008 12:20 AM
DLP-style FF.net Search Engine Olfrik General Discussion 21 07-28-2006 05:48 AM


All times are GMT -4. The time now is 01:48 AM.


Powered by vBulletin® Version 3.8.9
Copyright ©2000 - 2017, vBulletin Solutions, Inc.
Copyright ©2005 - 2016 DLP Group. All rights reserved.
No personal intellectual property on this site may be used without the credit and express permission of the respective authors.