Posted on 8th Apr 2015
You will have noticed something new on home page of my blog.....In short it's a live news feed. The feed is currently pulling MotoGP news from around the world.
I scrape the web (yes I developed the scrapper myself) for specific key words, in this case MotoGP. That data is stored in a XML document. I then filter that document and publish the results. The scrapper is running all the time looking for fresh, relevant news which is then passed to my filter where it is cleansed and the finally published.
There is an auto refresh every 10 minutes or so but as we get closer to weekend event it will change to a 1 minute refresh.
The beauty is that you will not have to refresh your browser it is all done automatically and will publish the fresh news as I get it. Currently I have scrapper looking for MotoGP, F1 and Super rugby.
All the programming was done in PHP and a bit of CURL.
I was thinking should I or shouldn't I...but decided to do it. The rates are updated every second (1000 ms) and I pull them in from the Yahoo financial pages. This was a little more complex but managed in the end. If you want to know how I did it just send me a mail.
Enjoy guys....and let me know if you want to see anything spesific to your interests.
Later G