Skip to main content
Solved

HTTPCaller : Retrieve page content after web worker completed

  • October 19, 2020
  • 2 replies
  • 18 views

nmatton
Contributor
Forum|alt.badge.img+4

Hello,

I have a web application that provides JSON results on a webpage. However, this results is created using javascript and web workers (mostly for efficiency purpose). Therefore, the javascript process takes some time to complete, and update the DOM content of the page.

As I result, the HTTPCaller transformer provides the page content before the update (and the JSON result being integrated).

 

I own the web service as well, do you think of a way (both in FME or on the web service side) to gather the JSON result in FME ?

 

Thanks !

Best answer by nmatton

Thanks for your reply, I was not aware of that.

 

Looking further, I found my answer here : https://community.safe.com/s/question/0D54Q000080hQX5SAM/how-to-read-dynamic-webpage-using-httpcaller

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

hkingsbury
Celebrity
Forum|alt.badge.img+65
  • Celebrity
  • October 19, 2020

Hey, I don't belive you'll be able to make this work. FME will only read the page contents and not parse any code (javascript).

 

An alternate way would be to replicate the JS logic on your page in FME


nmatton
Contributor
Forum|alt.badge.img+4
  • Author
  • Contributor
  • Best Answer
  • October 20, 2020

Thanks for your reply, I was not aware of that.

 

Looking further, I found my answer here : https://community.safe.com/s/question/0D54Q000080hQX5SAM/how-to-read-dynamic-webpage-using-httpcaller