I am wanting to feed in a number of web urls and I would like to find the host / server location (and IP address ideally) for the sites.
I seem to remember seeing this done at a conference on FME.
Thanks
Question
Can FME find the host location of a website?
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
Maybe you could use something like this service: http://ip-api.com/docs/
To split up an URL into the different bits and pieces you could use the "urlparse" Python module. It is mentioned in this old post, but unfortunately the code samples have been a bit mangled by an upgrade in the forum software: https://knowledge.safe.com/questions/2581/getting-parameters-from-a-url.html
+22- Contributor
Hi Seb,
Perhaps you could try our custom transformer the IPGeocoder to do this.
+6- Contributor
Many thanks both 1spatialdave and david_r.
I have gone with the ip-api.com version as it gives more detail on the ISP.
Many thanks
Seb
Maybe you could use something like this service: http://ip-api.com/docs/
To split up an URL into the different bits and pieces you could use the "urlparse" Python module. It is mentioned in this old post, but unfortunately the code samples have been a bit mangled by an upgrade in the forum software: https://knowledge.safe.com/questions/2581/getting-parameters-from-a-url.html
Our system will automatically ban any IP addresses doing over 150 requests per minute.
If that might be an issue, you could use a Decelerator to avoid hitting the limit, e.g. this will limit yourself to maximum 120 lookups per minute:
+6- Contributor
Maybe you could use something like this service: http://ip-api.com/docs/
To split up an URL into the different bits and pieces you could use the "urlparse" Python module. It is mentioned in this old post, but unfortunately the code samples have been a bit mangled by an upgrade in the forum software: https://knowledge.safe.com/questions/2581/getting-parameters-from-a-url.html
Thanks david_r
I spotted that as well. I don't think I will be hitting it with 150 requests a minute.
Thanks
Seb