Creating a new feed from webpage

Feed Creator
1

I have a little scraping issue

Ive made a feed from this page:

https://www.marketresearchdirect.com/agriculture-farming-raw-materials

and made this:http://createfeed.fivefilters.org/extract.php?url=https%3A%2F%2Fwww.marketresearchdirect.com%2Fagriculture-farming-raw-materials&in_id_or_class=both&url_contains=

I then made a RSS feed from it and got this: http://ftr-premium.fivefilters.org/makefulltextfeed.php?url=createfeed.fivefilters.org%2Fextract.php%3Furl%3Dhttps%253A%252F%252Fwww.marketresearchdirect.com%252Fagriculture-farming-raw-materials%26in_id_or_class%3Dboth%26url_contains%3D&key=2233&hash=06303621ae3dda5d03ef8ab8a04dc4b8c205018f&max=10&links=preserve

However, it doesnt bring back the full content from this page: https://www.marketresearchdirect.com/agriculture-farming-raw-materials/global-water-soluble-fertilizers-market-2019-2023

Can you help?

Paul

2

Hello? Is there a reason I havent had a reply on this?

3

Hi there, your third link doesn’t work for us here (says invalid key). Is that the problem you’re experiencing or that you’re getting results but not what you want? If so, what do you expect to be extracted from the page. If it’s something we can fix our end, we’d be happy to look into it.

4

Well, its kind of working. I am getting this:

http://ftr-premium.fivefilters.org/makefulltextfeed.php?url=createfeed.fivefilters.org%2Fextract.php%3Furl%3Dhttps%3A%2F%2Fwww.marketresearchdirect.com%2Fconsumer-goods%26in_id_or_class%3Dboth%26url_contains%3D&key=2233&hash=cd313d611c73e2429a558bb18f021c3ae5e29eb0&max=10&links=preserve

There are tabs on the page. I just want the Description Tab and not all the table of contents and other tab info.

Can that be done?

For help,this is an example page.
https://www.marketresearchdirect.com/consumer-goods/smart-lighting-market-in-india-2018-2023-market-report

5

Hi there, we’ve added an extraction rule to only consider the first tab’s contents as the result:

It will take a few hours for the changes to propagate to all servers, but after that when you generate feeds from the site, only the first tab’s contents should be produced.

6

Thank you, its working now, in terms of content capture. However, when I validate the RSS using an RSS validator, i get an error, saying that ‘a valid key must be supplied’. I purchased a subscription for a year in Feb 2019. What is the problem?

7

This appears to be a problem with the way Feed Validator handles encoded URL parameters. If you enter the URL in tinyurl.com first and then give Feed Validator the shortened tinyurl.com version, you should see it validates.