1. DLP Flash Christmas Competition + Writing Marathon 2024!

    Competition topic: Magical New Year!

    Marathon goal? Crank out words!

    Check the marathon thread or competition thread for details.

    Dismiss Notice
  2. Hi there, Guest

    Only registered users can really experience what DLP has to offer. Many forums are only accessible if you have an account. Why don't you register?
    Dismiss Notice
  3. Introducing for your Perusing Pleasure

    New Thread Thursday
    +
    Shit Post Sunday

    READ ME
    Dismiss Notice

Downloading Fanfics. Help?

Discussion in 'Fanfic Discussion' started by Xiph0, Jan 13, 2006.

  1. Xiph0

    Xiph0 Yoda Admin

    Joined:
    Dec 7, 2005
    Messages:
    9,498
    Gender:
    Male
    Location:
    West Bank
    I've heard people mention `downloading` fics, it would be awesome if someone could refer me to how, and which sites would allow this. :D
     
  2. Cervus

    Cervus Raptured to Hell

    Joined:
    Aug 29, 2005
    Messages:
    849
    Location:
    Manchester, England.
    It's my opinion that these people are using software in order to grab a web page and download it to their computer (cannot remember what this software is called). Problems arise with higher rated schoogle fics though.

    There is of course the simple method of choosing 'save as' from the file menu. Long winded I know but it still gets the job done nicely.
     
  3. Xiph0

    Xiph0 Yoda Admin

    Joined:
    Dec 7, 2005
    Messages:
    9,498
    Gender:
    Male
    Location:
    West Bank
    Yah *sigh*, I usually only read completed fics on days when I can whip through em, and doing "save as" for a 60 chap. fic just isn't an option.
     
  4. ip82

    ip82 Prisoner

    Joined:
    Nov 14, 2005
    Messages:
    2,921
    What you need is an offline downloader, which is a type of program that uses "web spider" to collect internet sites (html, pictures, whatever) and save them on your HD.

    The best program of this type, and the one that I use, is Teleport Pro. It's sharware with 30-days period but it can be easily... ahm... persuaded to work longer.


    Now, this is a description for fanfiction.net, coz it's the biggest archive.

    Before you begin anything, you need to create an index file. That is because FFN don't have index of all chapters on one page, like some sites do. So, to create an index file, do this:

    1) Open Notepad.

    2) Copy the code below inside an empty document.

    Code:
    <html>
    <head>
    <title>HP INDEX</title>
    </head>
    <body bgcolor="#FFFFFF" text="#000000">
    
    
    
    [b]Harry Potter Book Index[/b]</p>
    
    
    
    [url="http://www.fanfiction.net/s/*******/1/"]1[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/2/"]2[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/3/"]3[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/4/"]4[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/5/"]5[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/6/"]6[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/7/"]7[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/8/"]8[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/9/"]9[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/10/"]10[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/11/"]11[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/12/"]12[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/13/"]13[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/14/"]14[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/15/"]15[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/16/"]16[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/17/"]17[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/18/"]18[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/19/"]19[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/20/"]20[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/21/"]21[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/22/"]22[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/23/"]23[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/24/"]24[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/25/"]25[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/26/"]26[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/27/"]27[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/28/"]28[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/29/"]29[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/30/"]30[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/31/"]31[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/32/"]32[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/33/"]33[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/34/"]34[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/35/"]35[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/36/"]36[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/37/"]37[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/38/"]38[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/39/"]39[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/40/"]40[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/41/"]41[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/42/"]42[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/43/"]43[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/44/"]44[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/45/"]45[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/46/"]46[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/47/"]47[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/48/"]48[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/49/"]49[/url]</p>
    
    
    [url="http://www.fanfiction.net/s/*******/50/"]50[/url]</p>
    
    </body>
    </html>
    Note that this is for stories up to 50 chapters. If you need more, add more lines with numbers 51, 52, etc.

    3) Save this document as 0.htm, inside some low-level folder on HD. When I say low-level, I mean something that is easy to type - example "d:\0" or "c:\FD" (fic-download), etc. DON'T place it on Desktop or My Documents or some shit like that.

    You need to do this only once.


    Now that you have index prototype, you can download fic. Like this:

    1) Go to fanfiction.net and find the story you wish to download.

    2) Select the story's ID number and copy it to clipboard (CTRL+C). ID numbler is a part of page's adress (example: http://www.fanfiction.net/s/2625651/1/). You can also find it in the page's header, on the right side.

    3) Open your index file with Notepad. Go to Edit->Replace (or press Ctrl+H). In the "find" field enter 7 asteriks ("*******"). In the "replace" field paste the id numbler (CTRL+V) (exsample: "2625651"). Click on "Replace all".

    EDIT - forgot about this one...

    4) Select all the redundant lines and delete them.

    For example, if the story has 17 chapters, select lines from 18 to 50, like below:


    18</p>

    to


    50</p>

    (and then press del).


    5) Go to File->Save as. As file name paste the ID number (CTRL+V) and type ".htm" after it (example: "2625651.htm").

    6) Open Teleport Pro

    7) If there is already something open, go to File->New. Go to Project -> New starting adress.

    In "URL" field type:
    "[DOS-like path to your index file]\[Story's ID number - CTRL+V].htm".

    Example:
    "d:\0\2625651.htm" (that's why you need to choose simple path for the index file).

    Enter "1" in the upper edit field ("Explore pages no more than...")

    Select the bottom radio button ("no more than...") and type "1" in the lower edit field.

    Click OK.

    8) Click on start (Play button). When asked to save the project, do another CTRL+V and paste the story's ID numbler. Teleport will fix extension on it's own.

    That's it. Seems complicated, but it is done in 30 sec max once you get a hang of it.

    When the download is done, you'll find folder [Id numbler] inside the folder you put the index file (example: d:\0\2625651\). Go to that folder and open file index.htm. You get all the chapters, author's profile and the first page of reviews. You can now rename the folder to something better than bunch of numbers.

    If you need more help, feel free to ask.
    Cheers.
     
  5. Xiph0

    Xiph0 Yoda Admin

    Joined:
    Dec 7, 2005
    Messages:
    9,498
    Gender:
    Male
    Location:
    West Bank
    Thanks! :D
     
  6. Euphemism

    Euphemism First Year

    Joined:
    Dec 19, 2005
    Messages:
    24
    Location:
    Quebec
    Or you could use the De-FFNet-izer.
    http://deffnet.blogspot.com/
    Saves things in a nice format, too, and you can make your own CSS styles and whatnot.
     
  7. ip82

    ip82 Prisoner

    Joined:
    Nov 14, 2005
    Messages:
    2,921
    Hey, this looks great. I was thinking of writing something like this, but never had enough motivation to do it... Good to see someone has saved me the effort...

    EDIT:

    Just tried it out. Works great. It just need a new template set without all that flashy shit and will truly be perfect.

    I'm just not sure wheter I'll be using it, since all my other fics are downloaded manually. Since it takes me maybe 1 minute to set everything up manually, that's not much of an hasle...
     
  8. Aura

    Aura Seventh Year

    Joined:
    Nov 28, 2005
    Messages:
    266
    Location:
    In front of the monitor...
    Oh.... There's something like this. I must live in the stone age...

    I thought people downloading fics meant they copied it to word... that's what I usually did. Looking back, I marvel at the time I wasted Copying And Pasting individual chapters into MS word... :(
     
  9. Aura

    Aura Seventh Year

    Joined:
    Nov 28, 2005
    Messages:
    266
    Location:
    In front of the monitor...
    What the hell does this mean? What does it mean preferences? Can't find pref anywhere...
     
  10. ip82

    ip82 Prisoner

    Joined:
    Nov 14, 2005
    Messages:
    2,921
    File->Set Preferences

    Location to save is where you want your downloaded fics saved... could be anywhere

    Templates is where are html files the program will use as templates. You get a set with the program itself, so you shoud browse for the folder where you saved the program and open up "templates". For me, it's like this:

    C:/Program Files/deffnet/templates
     
  11. Aura

    Aura Seventh Year

    Joined:
    Nov 28, 2005
    Messages:
    266
    Location:
    In front of the monitor...
    Oh... I never saw that button before... I must be blind to the most obvious things.

    Loads of thanks for the help, IP.
     
  12. Xiph0

    Xiph0 Yoda Admin

    Joined:
    Dec 7, 2005
    Messages:
    9,498
    Gender:
    Male
    Location:
    West Bank
    :cheers: Woah! Just got this loaded up and tried it, very cool!
     
  13. DGD

    DGD Headmaster

    Joined:
    Oct 29, 2005
    Messages:
    1,075
    Location:
    Wisconsin, USA
    just tried it, works like a charm. Recomended
     
  14. bornagainpenguin

    bornagainpenguin DLP Archivist

    Joined:
    Oct 27, 2005
    Messages:
    780
    Location:
    Illinois
    :O_O: God DAMN! How could I have lived before this?

    No more getting twitchy fingers after doing ctrl+ s on a 100 plus chapter fic!:wall:

    You sir are my new best friend!

    :cheers: :cheers: :cheers: :cheers:

    --bornagainpenguin (who's off to sahre the news of this prgram with a few other forums!)
     
  15. Scarty

    Scarty Denarii Host DLP Supporter

    Joined:
    Jan 15, 2006
    Messages:
    170
    Location:
    Germany
    Ahh THX for this little prog, i searched long for sth like this.

    *bow*
     
  16. Aiden_Arlen

    Aiden_Arlen Guest

    :wall:
    0Sniff0 it doesn't work anymore, or at least for me
     
  17. bornagainpenguin

    bornagainpenguin DLP Archivist

    Joined:
    Oct 27, 2005
    Messages:
    780
    Location:
    Illinois
    Are you using a firewall or peerguardian to block http?

    I noticed the program was unable to run unless I stopped blocking http. It would just give an error message about the log and end. is this what you're seeing?

    --bornagainpenguin

    PS: You should probably use the mailing list for more advice than we'll be able to give: http://www.inklesspen.com/deffnet/#list
     
Loading...