Donate to Remove ads

Got a credit card? use our Credit Card & Finance Calculators

Thanks to johnstevens77,Bhoddhisatva,scotia,Anonymous,Cornytiv34, for Donating to support the site

Copyright-safe TMF post extractor

Formerly "Lemon Fool - Improve the Recipe" repurposed as Room 102 (see above).
Meatyfool
Lemon Slice
Posts: 313
Joined: November 4th, 2016, 11:43 am
Has thanked: 2 times
Been thanked: 55 times

Copyright-safe TMF post extractor

#703

Postby Meatyfool » November 5th, 2016, 11:03 am

How's this for an idea?

Scraping technology is coded to extract posts from the tmf page that lists the users posts in time order NOT from a board list.

Bear with me.

This ensures that that the user/a willing volunteer can extract their posts in a copyright safe manner. TMF may permit said scraper to operate on their servers as they will have the tech at hand to prevent scraper bot from operating - they are obliged to protect the copyright?

I would expect that each extracted post would be given a unique primary key by the software. This along with

Board name
User name
Post date and time
Etc

Could be uploaded into a spreadsheet as an aid to rebuilding a thread.

Resultant data extract is then NOT loaded into Lemonfool.

Posts will only be added a board at a time.

So when enough users have contributed their posts to enable the "meat" of the board to be visible, the upload begins.


Additional proposal.

If we extracted board post lists too (which would be under TMF copyright), We could fill in blanks in a thread with a post purporting to be from that user with text "This TMF post was not retrieved".


Lastly, and not hopefully,

We could request permission from TMF to extract all posts under legal terms indicating that the posts would not be published until such time as the user approaches us and gives permission.

Identifying if they are the true user is difficult to achieve as anyone could go back to the internet archive and gather information from those posts to fool anyone checking identity.

And no way are TMF going to give us permission to have their customer database and could for email back password reminders. What if we agreed to buy it?

Just a few ideas, from possible to dumb!

Meatyfool

Return to “Room 102 - Site Issues, Complaints & General Chat”

Who is online

Users browsing this forum: No registered users and 11 guests