Donate to Remove ads

Got a credit card? use our Credit Card & Finance Calculators

Thanks to DrFfybes,Anonymous,UncleEbenezer,bofh,88V8, for Donating to support the site

Simple Price Scrape updated to v2.5

Discussions regarding financial software
kiloran
Lemon Quarter
Posts: 4378
Joined: November 4th, 2016, 9:24 am
Has thanked: 3303 times
Been thanked: 3057 times

Simple Price Scrape updated to v2.5

#701187

Postby kiloran » December 18th, 2024, 2:50 pm

The Simple Price Scrape started out as a simple dump of data from Yahoo. This was great, many shares could be downloaded with one web query, it covered all the major global exchanges, and reported indices and exchange rates. Some funds were available, though not all.
Over the years, Yahoo has thrown a few tantrums, and though it still covers the same breadth of data, it now requires one web query per share... not a major disaster, but it is a bit slower. Last week it was reported that some/all fund prices were incorrectly reported in pounds instead of pence, so reliability is still questionable.

We then added the Shareprices web site as an alternative source of data. This is OK for many people, but it only covers UK shares and ETFs.

Another added option was for Fund prices, using the Financial Times as a source. Although it was intended for Funds, in practice it also provided data for shares from most global markets, ETFs, indices, bonds and exchange rates, although in a few cases there were some errors extracting the data.
Version 2.5 has cleaned this up, and the "FT Funds" sheet has been replaced by the "FT" sheet. It now extracts the share name and provides a link to the relevant FT page. If Yahoo has more problems in the future, it looks like the FT will be a credible and reliable alternative source of data.

Version 2-5 for Excel and LibreOffice is available at: https://lemonfoolfinancialsoftware.weeb ... crape.html

Image

--kiloran

PeteHutch
Posts: 21
Joined: September 29th, 2017, 1:11 pm
Has thanked: 50 times
Been thanked: 8 times

Re: Simple Price Scrape updated to v2.5

#727052

Postby PeteHutch » May 8th, 2025, 11:15 pm

The LibreOffice Yahoo updates stopped working for me a couple of days ago. I'm getting question marks instead of prices. The shareprices tab still works ok though.

Anybody else having problems or is it just me?

It's not quite the latest version but I'm using Libreoffice 25.2.0.3 on Windows 10

kiloran
Lemon Quarter
Posts: 4378
Joined: November 4th, 2016, 9:24 am
Has thanked: 3303 times
Been thanked: 3057 times

Re: Simple Price Scrape updated to v2.5

#727055

Postby kiloran » May 8th, 2025, 11:20 pm

PeteHutch wrote:The LibreOffice Yahoo updates stopped working for me a couple of days ago. I'm getting question marks instead of prices. The shareprices tab still works ok though.

Anybody else having problems or is it just me?

It's not quite the latest version but I'm using Libreoffice 25.2.0.3 on Windows 10

Yes, I see the same thing. The Excel version seems to be OK.
I'll look at it tomorrow.

--kiloran

PeteHutch
Posts: 21
Joined: September 29th, 2017, 1:11 pm
Has thanked: 50 times
Been thanked: 8 times

Re: Simple Price Scrape updated to v2.5

#727147

Postby PeteHutch » May 9th, 2025, 6:44 pm

kiloran wrote:
PeteHutch wrote:The LibreOffice Yahoo updates stopped working for me a couple of days ago. I'm getting question marks instead of prices. The shareprices tab still works ok though.

Anybody else having problems or is it just me?

It's not quite the latest version but I'm using Libreoffice 25.2.0.3 on Windows 10

Yes, I see the same thing. The Excel version seems to be OK.
I'll look at it tomorrow.

--kiloran


Thanks. There's no rush - the Shareprices tab does all I need. I'm starting to think I'm the only LibreOffice user here.

niord
Lemon Pip
Posts: 80
Joined: November 4th, 2016, 3:15 pm
Has thanked: 814 times
Been thanked: 20 times

Re: Simple Price Scrape updated to v2.5

#727148

Postby niord » May 9th, 2025, 7:15 pm

PeteHutch wrote:
kiloran wrote: Yes, I see the same thing. The Excel version seems to be OK.
I'll look at it tomorrow.

--kiloran


Thanks. There's no rush - the Shareprices tab does all I need. I'm starting to think I'm the only LibreOffice user here.


Nope, I use LibreOffice and use the shareprice tab all the time. No problems

kiloran
Lemon Quarter
Posts: 4378
Joined: November 4th, 2016, 9:24 am
Has thanked: 3303 times
Been thanked: 3057 times

Re: Simple Price Scrape updated to v2.5

#727209

Postby kiloran » May 12th, 2025, 3:20 pm

PeteHutch wrote:The LibreOffice Yahoo updates stopped working for me a couple of days ago. I'm getting question marks instead of prices. The shareprices tab still works ok though.

Anybody else having problems or is it just me?

It's not quite the latest version but I'm using Libreoffice 25.2.0.3 on Windows 10

It looks like Yahoo is now detecting the LibreOffice price scrape software as a bot (which it is, though a friendly one!) and has blocked the web query. Perhaps this has been prompted by the recent proliferation of malicious bots, such as those affecting LemonFool.

I've got the essence of a workaround up and running, so will hopefully publish a fix in the next day or two.

I'm not sure why the Excel version is still OK. The software is very different, for sure.

--kiloran

kiloran
Lemon Quarter
Posts: 4378
Joined: November 4th, 2016, 9:24 am
Has thanked: 3303 times
Been thanked: 3057 times

Re: Simple Price Scrape updated to v2.5

#727646

Postby kiloran » May 15th, 2025, 8:55 pm

kiloran wrote:
PeteHutch wrote:The LibreOffice Yahoo updates stopped working for me a couple of days ago. I'm getting question marks instead of prices. The shareprices tab still works ok though.

Anybody else having problems or is it just me?

It's not quite the latest version but I'm using Libreoffice 25.2.0.3 on Windows 10

It looks like Yahoo is now detecting the LibreOffice price scrape software as a bot (which it is, though a friendly one!) and has blocked the web query. Perhaps this has been prompted by the recent proliferation of malicious bots, such as those affecting LemonFool.

I've got the essence of a workaround up and running, so will hopefully publish a fix in the next day or two.

I'm not sure why the Excel version is still OK. The software is very different, for sure.

--kiloran

Version 2-6 has been published. See: viewtopic.php?f=27&t=46886

Hopefully that fixes the problem (for now!)

--kiloran


Return to “Financial Software - Discussion”

Who is online

Users browsing this forum: No registered users and 4 guests