Skip to main content
Solved

HTTPCaller : Retrieve page content after web worker completed


nmatton
Contributor
Forum|alt.badge.img+4

Hello,

I have a web application that provides JSON results on a webpage. However, this results is created using javascript and web workers (mostly for efficiency purpose). Therefore, the javascript process takes some time to complete, and update the DOM content of the page.

As I result, the HTTPCaller transformer provides the page content before the update (and the JSON result being integrated).

 

I own the web service as well, do you think of a way (both in FME or on the web service side) to gather the JSON result in FME ?

 

Thanks !

Best answer by nmatton

Thanks for your reply, I was not aware of that.

 

Looking further, I found my answer here : https://community.safe.com/s/question/0D54Q000080hQX5SAM/how-to-read-dynamic-webpage-using-httpcaller

View original
Did this help you find an answer to your question?

2 replies

hkingsbury
Celebrity
Forum|alt.badge.img+53
  • Celebrity
  • October 19, 2020

Hey, I don't belive you'll be able to make this work. FME will only read the page contents and not parse any code (javascript).

 

An alternate way would be to replicate the JS logic on your page in FME


nmatton
Contributor
Forum|alt.badge.img+4
  • Author
  • Contributor
  • Best Answer
  • October 20, 2020

Thanks for your reply, I was not aware of that.

 

Looking further, I found my answer here : https://community.safe.com/s/question/0D54Q000080hQX5SAM/how-to-read-dynamic-webpage-using-httpcaller


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings