Hi Juan,
Without selector it is very difficult to fetch the required details. if you dot`t know particular selector then you can directly use html tags like “p”, “span”, “div” or any other tag which you think it contains required information.
Other wise you can use contact us page to send me secret message with website url and details which you want to extract.
Thank for your work ! Just a come back, I have tried some use cases and meet issue in those cases :
– working behind proxy. I have used TSetProxy but connection doesn’t success
– working with local file. I have used “file:///…” but connection doesn’t success. Reading Soup API, they talk about Parse method : “There is a sister method parse(File in, String charsetName) which uses the file’s location as the baseUri. This is useful if you are working on a filesystem-local site and the relative links it points to are also on the filesystem.”
Implement the local file case will be really interesting ;))
Regards
Hi,
I am trying to crawl HTML webpage table data’s using tHTMLInput component with particular tag attributes. Here If empty row data availed into table, Then Its repeating all column data again into that empty row. Below Job sample I am trying.
tHTMLInput > tMap > tFileOutputDelimited
Exact Question : How can I avoid empty tag attribute values after crawled data?
Hi,
I am trying to crawl HTML webpage table data’s using tHTMLInput component with particular tag attributes. Here If empty row data availed into table, Then Its repeating all column data again into that empty row. Below Job sample I am trying.
tHTMLInput > tMap > tFileOutputDelimited
Exact Question : How can I avoid empty tag attribute values after crawled data?
Hello there.
Thanks a lot for this tutorial!!
But… I don’t know hot to extract data from a website table.
I don’t know how to search into source code, what can I use in Mapping area (Selector Code)?
Hi Juan,
Without selector it is very difficult to fetch the required details. if you dot`t know particular selector then you can directly use html tags like “p”, “span”, “div” or any other tag which you think it contains required information.
Other wise you can use contact us page to send me secret message with website url and details which you want to extract.
Thank You
Dwetl team
Hello how I can get the attribute value src of an image like this?
Hi Aser,
You can use
img[src]as a selector and add require attributes.Give us an example of this please, and do u mean by add require attributes.Thanks a lot.
thank you for this great tool, but the extraction of a link in a Href of an tag is quite difficult.
I tried the example showed here and it didn’t work and even your reply to Aser didn’t clarify the issue.
So how to extract link from an anchor tag ?
Best regards.
I will submit newer version soon, but some of the feature may not seen in that. you can provide test case to test it.
Thx you dwelt for this great component.
It works for me. I have forgot to set the type to Object so I dont get the whole tag.
An other question.
How I can get the redirected links?
Can you make a tutorial?
Thank You Aser,
I will test for Redirected Links and give some tutorials.
Thank for your work ! Just a come back, I have tried some use cases and meet issue in those cases :
– working behind proxy. I have used TSetProxy but connection doesn’t success
– working with local file. I have used “file:///…” but connection doesn’t success. Reading Soup API, they talk about Parse method : “There is a sister method parse(File in, String charsetName) which uses the file’s location as the baseUri. This is useful if you are working on a filesystem-local site and the relative links it points to are also on the filesystem.”
Implement the local file case will be really interesting ;))
Regards
Thanks Piaf, its rely interesting, i will give a try and then upload newer version of component.
how to call class value..?
example:
Hello World
Output:democlass
In the above code i need value of class..How can i write code for calling the value of class in tHTMLINPUT..?
you can write a class in routines and then call the method in tHTMLINPUT component, if you put some example then we can suggest you better.
Hi,
I am trying to crawl HTML webpage table data’s using tHTMLInput component with particular tag attributes. Here If empty row data availed into table, Then Its repeating all column data again into that empty row. Below Job sample I am trying.
tHTMLInput > tMap > tFileOutputDelimited
Exact Question : How can I avoid empty tag attribute values after crawled data?
Hi,
I am trying to crawl HTML webpage table data’s using tHTMLInput component with particular tag attributes. Here If empty row data availed into table, Then Its repeating all column data again into that empty row. Below Job sample I am trying.
tHTMLInput > tMap > tFileOutputDelimited
Exact Question : How can I avoid empty tag attribute values after crawled data?
Can you put more details like your source data and then output you get, i want to reproduce it, i can assist better.
I just have a self-made html file. What should I provide in the URL field of tHTMLInput Component ?
file name with path
how to write for inner div data
div–>ul—>li–>div—>
Hi sir.
Im new in talend and development.
Im trying to get data from a html table ( https://s27.postimg.org/56yzbhxvn/print.png ).
I need to get all three columns and rows.
But I’m getting an error (java.lang.NullPointerException), could you help-me ?
(https://s28.postimg.org/c1mw2oefx/Sem_t_tulo.png)