Skip to main content
Solved

TweetSearcher Authentication Issue

  • July 11, 2017
  • 12 replies
  • 34 views
K

I am using TweetSearcher on FME Desktop 2016 to find tweets with a keyword and within a bounding box. I used my Twitter login details and it was working absolutely fine earlier.

However, since a few days, I am not able to use the same workbench and it returns an error

Received HTTP response header: 'HTTP/1.1 403 Forbidden' from 'https://api.twitter.com/oauth/access_token'

Could you suggest how can this issue be resolved. I can not find parameters in TweetSearcher to provide any access token.

Thanks in advance!

Best answer by jlutherthomas

As a temporary workaround, you may be able to use the Twitter API through a HTTPCaller.

 

In this question I mention how to I have spoken about how to authenticate with it, and then use the general Twitter search tool. I'm not sure what the limitations are from the authentication method. https://knowledge.safe.com/questions/45854/httpcaller-and-twitter-api-authentication-problems.html
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

12 replies

danilo_fme
Celebrity
Forum|alt.badge.img+52
  • danilo_fmeCelebrity
  • Celebrity
  • July 11, 2017

Hi @kanishk3687,

I installed the FME Desktop 2017 1.0.0 ( Build 17523 - Beta ) and tested the transformer but without success. The same error was show in the Log file :(.

I checked that the url to send request in twitter actually is: https://dev.twitter.com/oauth and not https://api.twitter.com/oauth/access_token that is generate by transformer TweetSearch.

I believe the reason the error is the URL.

Thanks in Advance

Partner Solutial Brazil - www.solutial.com.br
K
  • kanishk3687
  • Author
  • July 11, 2017

Hi @danillo_inovacao,

Thank you for quick response. I checked Twitter API and it mentions about access_tokens (https://dev.twitter.com/oauth/reference/post/oauth/access_token), however, I am not sure what is the workflow of FME TweetSearcher Transformer.

Strangely, it was all working fine a few days back. That means, there must be some recent changes within Twitter API.

mark2atsafe
Safer
Forum|alt.badge.img+59

My guess is that Twitter have changed something. I've flagged it as a high-priority issue with our developers and will get back to you.

FME Evangelist to the Rich and Famous!!
danilo_fme
Celebrity
Forum|alt.badge.img+52
  • danilo_fmeCelebrity
  • Celebrity
  • July 11, 2017

Hi @kanishk3687, like @Mark2AtSafe wrote the URL was changed. :)

Partner Solutial Brazil - www.solutial.com.br
J
Forum|alt.badge.img+2

As a temporary workaround, you may be able to use the Twitter API through a HTTPCaller.

 

In this question I mention how to I have spoken about how to authenticate with it, and then use the general Twitter search tool. I'm not sure what the limitations are from the authentication method. https://knowledge.safe.com/questions/45854/httpcaller-and-twitter-api-authentication-problems.html
colinhenderson

My guess is that Twitter have changed something. I've flagged it as a high-priority issue with our developers and will get back to you.

Hi @Mark2AtSafe any news on this one? All my workspaces with TweetSearcher are now failing with 403 Forbidden and causing me some headaches!

 

fmelizard
Safer
Forum|alt.badge.img+21
  • fmelizardSafer
  • Safer
  • August 1, 2017

As a temporary workaround, you may be able to use the Twitter API through a HTTPCaller.

 

In this question I mention how to I have spoken about how to authenticate with it, and then use the general Twitter search tool. I'm not sure what the limitations are from the authentication method. https://knowledge.safe.com/questions/45854/httpcaller-and-twitter-api-authentication-problems.html
Hi @colinhenderson. Did you try @jlutherthomas's workaround suggestion?
mark2atsafe
Safer
Forum|alt.badge.img+59
  • mark2atsafeSafer
  • Safer
  • August 1, 2017
Hi @Mark2AtSafe any news on this one? All my workspaces with TweetSearcher are now failing with 403 Forbidden and causing me some headaches!

 

Not yet. I've been off on vacation until today, so I will check it out and see what the status is.

 

 

FME Evangelist to the Rich and Famous!!
mark2atsafe
Safer
Forum|alt.badge.img+59
  • mark2atsafeSafer
  • Safer
  • August 1, 2017
Hi @Mark2AtSafe any news on this one? All my workspaces with TweetSearcher are now failing with 403 Forbidden and causing me some headaches!

 

It seems to be a bigger issue than you would expect. It means adding some extra OAuth support and that means updating both the engine and the interface. From what I can see I wouldn't expect a solution in the next couple of weeks (I just don't see an imminent fix). Can you go with the HTTPCaller workaround for now?

 

 

NB: It's not that we aren't doing anything - I can see lots of action going on in development. It's just going to be a longer time than I think anyone realized at first.

 

 

as an fyi, in the future I think transformers like these will end up being moved to the FME Store. That way they can be updated without you having to update FME every time (though having said that, the combination of OAuth and interface changes might have made it necessary anyway in this case).

 

 

FME Evangelist to the Rich and Famous!!
colinhenderson

My guess is that Twitter have changed something. I've flagged it as a high-priority issue with our developers and will get back to you.

Was hoping to avoid the HTTPCaller workaround, but since that seems like the way forward for now I'll implement it.

 

 

fmelizard
Safer
Forum|alt.badge.img+21
  • fmelizardSafer
  • Safer
  • August 3, 2017
Was hoping to avoid the HTTPCaller workaround, but since that seems like the way forward for now I'll implement it.

 

 

Yes, dealing with the authentication issue has been more trying because Twitter's approach is different than the others (Google, Salesforce, Dropbox, etc) that we support now. We are close to having the new support into a Beta FME 2017.1.1 - and if you don't need this on FME Server we may be able to get you something sooner rather than later. Let us know your timelines (via live chat or support@safe.com) and we can advise on options. Our goal is to release 2017.1.1 in early Sept.

 

 

colinhenderson
Yes, dealing with the authentication issue has been more trying because Twitter's approach is different than the others (Google, Salesforce, Dropbox, etc) that we support now. We are close to having the new support into a Beta FME 2017.1.1 - and if you don't need this on FME Server we may be able to get you something sooner rather than later. Let us know your timelines (via live chat or support@safe.com) and we can advise on options. Our goal is to release 2017.1.1 in early Sept.

 

 

Thanks Dale, will need this on server and timeline is pressing - this week! I have created a custom transformer which I'll share on the FME Hub as I needed some additional functionality as well - multiple tweet searching - so I was already wrapping the original transformer anyway.

 

 

Community Stats

32,154
Posts
122,047
Replies
39,812
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.