Skip to main content
Question

FME Best Practice Validation Project (You Can Help!)


Show first post

50 replies

Forum|alt.badge.img
  • April 13, 2017
mark2atsafe wrote:
Fantastic. I like that. I wish I could be there to see the presentation.

 

@jdh This tool is a command line application and does not require a specific version control. It can be integrated in any source control tool accepting external compare program to compare two version of a file as we did with subversion.

 


jdh
Contributor
Forum|alt.badge.img+28
  • Contributor
  • April 13, 2017
mark2atsafe wrote:
Fantastic. I like that. I wish I could be there to see the presentation.

 

Ah, when I asked I was told it required svn.

 

 


Forum|alt.badge.img
  • April 13, 2017
mark2atsafe wrote:
Fantastic. I like that. I wish I could be there to see the presentation.

 

As the developer of the tool, I can assure you that SVN is not required. I'll make sure that the presenter is aware of this for the future.

 

 


sigtill
Supporter
Forum|alt.badge.img+24
  • Supporter
  • April 19, 2017
mark2atsafe wrote:
The attachment seems to have gone missing. Do you have a copy of it still?

 

 

I hate that i dont get notifications when someone answers my posts (answerhub-issue) - just saw this. However I could successfully download the *.zip file .... is it ok now? And I cant seem to (a)mark2atsafe.

 

 


Forum|alt.badge.img
  • December 8, 2017
mark2atsafe wrote:
Fantastic. I like that. I wish I could be there to see the presentation.

 

Hi @KenAtSafe,

 

I'll try to see if I can find the presentation. It may be in french. No the code is not available but we are planning to open this as a web service for the beginning. I'll post the URL here as soon as it is done.

 


Forum|alt.badge.img
  • December 8, 2017
mark2atsafe wrote:
Fantastic. I like that. I wish I could be there to see the presentation.

 

Hi @KenAtSafe,

 

The presentation is strictly based on a demo, I'll try to make the web service live ASAP. In the mean time, if you want to have a little private demo or two workspaces compared, just email them to me.

 


fmelizard
Safer
Forum|alt.badge.img+19
  • Safer
  • December 13, 2017

Thanks @larry ! I'll be in touch


runneals
Contributor
Forum|alt.badge.img+22
  • Contributor
  • August 31, 2018
mark2atsafe wrote:
I just filed PR#76897 - a request for a Notification service that is a Repository Watcher. It would be like a Directory Watcher but would issue a notification if a workspace is published to a particular repository.

 

 

That way you could run a testing workspace in response - but you also get the ability to be notified in general when a workspace is published or updated.

 

 

Validating before publishing to Server - well that would need us to incorporate this whole idea into Desktop functionality (and I just don't see that happening - at least not as easily as a Repository Watcher might).

 

You can kind of do this with a directory watch to the repositories directory

Forum|alt.badge.img+2
larry wrote:
Hi @KenAtSafe,

 

The presentation is strictly based on a demo, I'll try to make the web service live ASAP. In the mean time, if you want to have a little private demo or two workspaces compared, just email them to me.

 

Hi @larry,

We are currently looking into possible solutions for comparing workspace versions. Would you be available for a demonstration of this tool? Please let me know if you are happy to do this and I can reach out via email to pin down a date.


Forum|alt.badge.img
  • November 13, 2018
hollyatsafe wrote:

Hi @larry,

We are currently looking into possible solutions for comparing workspace versions. Would you be available for a demonstration of this tool? Please let me know if you are happy to do this and I can reach out via email to pin down a date.

Hello @hollyatsafe,

I'm no longer working with Consortech but you can contact them as they are a SAFE partner.

Ping me back if you can't reach them or if they do not get back to you.

Regards,

Larry

 

 


mrclaudepicard
hollyatsafe wrote:

Hi @larry,

We are currently looking into possible solutions for comparing workspace versions. Would you be available for a demonstration of this tool? Please let me know if you are happy to do this and I can reach out via email to pin down a date.

Hello @hollyatsafe,

I'd gladly demo the Workspace Comparator for you.

Contact me by email to set a date.

C.


Forum|alt.badge.img
  • March 13, 2019

@mark2atsafe I left some issues on the Github page, but what is the preferred place for it? I am working on an updated version, with more checks and would like to get involveld.


mark2atsafe
Safer
Forum|alt.badge.img+45
  • Author
  • Safer
  • March 13, 2019
bzwemmer wrote:

@mark2atsafe I left some issues on the Github page, but what is the preferred place for it? I am working on an updated version, with more checks and would like to get involveld.

Yes, sorry about not responding before. It's just a busy time at the moment. I really would like to get this project back up and running. It's an important one to me. I think Github is the right place for it right now. Eventually it might live on the FME Hub (which is getting some great new updates for 2019 that will really help). I think for now if you can post changes back to Github that would be great. Once the FME 2019 release is done and I have all my training updates and blog posts complete, I'll take the time to dive back into this and see where we're at.

Thanks so much for getting involved. I do think this is a useful project and between us we'll get it fixed up and enhanced for sure.


Forum|alt.badge.img
  • March 14, 2019
mark2atsafe wrote:

Yes, sorry about not responding before. It's just a busy time at the moment. I really would like to get this project back up and running. It's an important one to me. I think Github is the right place for it right now. Eventually it might live on the FME Hub (which is getting some great new updates for 2019 that will really help). I think for now if you can post changes back to Github that would be great. Once the FME 2019 release is done and I have all my training updates and blog posts complete, I'll take the time to dive back into this and see where we're at.

Thanks so much for getting involved. I do think this is a useful project and between us we'll get it fixed up and enhanced for sure.

Thanks, I will do that soon.


runneals
Contributor
Forum|alt.badge.img+22
  • Contributor
  • May 6, 2019

Working on creating a formalized document with best practices. Stuck on Web/Database Connections and using them on server. I think ideally there would only be 1 connection per account that it's for (ie. 1 connection to 1 user on ArcGIS Online). BUT how do you manage access to them if that's the case? Or is it easier and better to just let anyone create their own connections and automatically get access since they own it? Is there any pros/cons to doing it the former vs latter?


laurawatsafe
Safer
Forum|alt.badge.img+11
runneals wrote:

Working on creating a formalized document with best practices. Stuck on Web/Database Connections and using them on server. I think ideally there would only be 1 connection per account that it's for (ie. 1 connection to 1 user on ArcGIS Online). BUT how do you manage access to them if that's the case? Or is it easier and better to just let anyone create their own connections and automatically get access since they own it? Is there any pros/cons to doing it the former vs latter?

Hi @runneals, In my experience, it's easier to let anyone create their own connections when working on FME Server. That ensures that only the account that created the connection can use or modify it by default. The owner of a connection does have the ability to share it with other users/roles as well, so if they wanted to allow others to have access to it, they can do so.

Having one connection per account could be helpful if you don't want your FME Server users to have their own credentials for the service (like AGOL) being used. For that, the owner of the connection can share it with a specific role to let any users part of that role have access to the connection. The drawback to this is that we currently don't have 'read only' access for connections, so sharing it would mean that any user could edit it.


runneals
Contributor
Forum|alt.badge.img+22
  • Contributor
  • June 14, 2019
sigtill wrote:

Would be great if this was run right after you hit "Publish to FME Server" on the File menu of FME Workbench - so you could validate it BEFORE you publish it to an FME Server. Or more in generall - add an option to run a custom workspace before "Publish to FME Server" to validate something in that particular fmw workspace - for instance that all your database-connections are connected to staging/dev/prod and with the correct user / paths etc. When uploading to multiple FME Servers dev/stage/prod this can easily be forgotten!

You could probably set up an automation, and then send an email to the user that uploaded it.


runneals
Contributor
Forum|alt.badge.img+22
  • Contributor
  • June 20, 2019

Thanks to all you fine folks who provided comments here. I have put together a formal best practices guide.

Check out the updated version 1.1 (thanks to @mmccart for some additional feedback/ideas that I originally overlooked and merged with my original): https://github.com/runneals/GISProjects/tree/master/fme/FME%20Best%20Practices


sigtill
Supporter
Forum|alt.badge.img+24
  • Supporter
  • October 22, 2019

Bumping this post up, because this can be useful to many also in 2019!


mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

@larry​ - Can you please share which tool you're describing here for FMW DIFF? Since this post is quite old, I'm not sure if there's a new tool available to diff purposes. I tried GIT but it's a great deal with FMW file format.


Forum|alt.badge.img
  • January 25, 2022
mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

Hello Ravin,

 

This is an old internal tool Consortech was developing while I was working there.

My best suggestion is for you to try to contact them and see if this is maintained and still available.

And please et me know if you can't have an answer, I can give you some hints if you want to develop your own tool.

 

Regards,

Larry


mark2atsafe
Safer
Forum|alt.badge.img+45
  • Author
  • Safer
  • January 25, 2022
mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

Check out FME2022 (still in beta, but will be released shortly). It has a visual comparison tool that sounds like it would help.


mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

That would be great! Thanks. I'll try that out and post results.


mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

Thanks Larry


Forum|alt.badge.img
  • January 25, 2022
mark2atsafe wrote:
@sigtill @redgeographics and others - I'm just wondering about the best way to set this up on GitHub. If there are commit conflicts then it's very hard to assess what the differences are using GitHub itself. You'd need to open them in FME and do a visual inspection to see any differences (writing a DIFF tool for FME workspaces - that sounds like another challenge!)

 

 

Anyway, I think one way to help minimize that - and to make the project more manageable - is to split off each of the sections into exported custom transformers. It becomes a little harder to 'install' into FME, but I think the other advantages outweigh that.

 

 

So I'm going to do that and see if I can get it into GitHub sometime today.

 

I'm glad to hear that. Not using FME these days but I'll give it a try as soon as I get back to it!


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings