Author Topic: Pulling Data from Website?  (Read 48 times)

Nemosity

  • Newbie
  • *
  • Posts: 15
Pulling Data from Website?
« on: July 20, 2021, 09:22:20 pm »
Hello!  I am knee deep in a complicated process of implementing RDS data across our network of News and Classical stations.  Each time period is bringing it's own challenges to this process.  However, the data we want to be displayed is already up on our website.  Is there a way I can use the P332 to point to the website and read the specific widget to pull the data we want for RDS?  TYIA

Jan

  • Hero Member
  • *****
  • Posts: 749
Re: Pulling Data from Website?
« Reply #1 on: July 20, 2021, 09:36:49 pm »
The P132/P332 includes a readweb function. This built-in function is however obsolete as it is limited to http protocol and max. 255 characters. For reading and processing of complex web sites, you may use the Magic RDS 4 - it also includes a powerful XML/XHTML and JSON parsers and other tools for extraction of the text string required. The Task scheduler tool may help you to select individual sites, based on the day, time, date and other events.

Nemosity

  • Newbie
  • *
  • Posts: 15
Re: Pulling Data from Website?
« Reply #2 on: July 24, 2021, 06:45:51 pm »
Hello Jan!  Is there an instruction manual on how to make this happen?  If I can pull data from a widget on an internet webpage, it would simplify the process of pushing RDS data across our network.  I am sure there are others out there that would like to do this as well.  Perhaps if I can get this working I can create a how to video in English, as I am sure it would push sales of these nice encoders up! 

Jan

  • Hero Member
  • *****
  • Posts: 749
Re: Pulling Data from Website?
« Reply #3 on: July 24, 2021, 10:43:35 pm »
We don't have any manual, I'm sorry.

A good news is that a big part of websites can be read and processed.
A bad news is that each case is unique and individual. In many cases, it cannot be done without knowledge of HTML language and without some programming skills. Sometimes, there's no way (need to login etc.).

The problem is at the beginning: Somebody forgot to provide a suitable machine-to-machine output from the broadcast automation. In the final result, some information may be lost and a huge package of 'information' has been added, like text formatting, page layout, ads etc., 1 MB of rubbish which somewhere contains the 64 characters of the original text. The rest of the data is entirely useless for getting the original information we want to collect. Thus it is preferable to collect the text information so close to the original source as possible. Usually a good webmaster should provide appropriate help and access to the information.

Nemosity

  • Newbie
  • *
  • Posts: 15
Re: Pulling Data from Website?
« Reply #4 on: July 29, 2021, 10:46:46 pm »
UPDATE: 

The good folks at NPR digital were able to give me a link to the data/widget that they use for our website's Now Playing.  A few quick adjustments within the Magic RDS 4 software to add external text sources for Radio Text and I have metadata populating the RDS on our broadcasts.  It really was quite simple as soon as I had the link.  We are a public radio station in the USA and NPR digital services provides json, string, and html links for our data in the Now Playing widget on the website.