Does anyone have a routine or know how to build a routine to access a webpage, make a selection from a dropdown menu, and then select save at a pop up window? I'm sure this can be done in Python, but I do not have the background.
Question
Data Scraping with Download
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
+15- Supporter
Hi @rick_williams,
May I know what kind of information you would like to retrieve from the web page? Are those tables?
+59- Safer
If it's data served by FME Server then the server API would be a good solution. Otherwise try examine the code for the page and see if the menu can be incorporated somehow into a call from a HTTPCaller transformer. Though how you save content from a pop-up window I don't know.
+22- Contributor
In google chrome you can use developer tools to inspect the calls that are going. The HTTPCaller is your friend to use these. There is also the "HTML Table" - Reader that can read html tables from a webpage. If you really want to do mouse-clicks then you can try to download a mouse-recorder and call it with the SystemCaller transformer. A FeatureReader can be used to get the data back into the workspace.
Login to the community
No account yet? Create an account
An FME Account is required to contribute
LoginEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.