Creating and organizing workspaces. How to use Workbench.
Recently active
Hi, I made a workspace that creates folders and uploads files on a web API with the HTTP caller. The first version created folders at one level then uploaded files. Then it went on to do the next level and so on. So it was basically a series of HTTPcallers which worked fine on both desktop and Cloud. However since it's impossible to know how many folder levels there are in advance I made it with a custom loop transformer and just one HTTP caller. This worked even better on desktop but trying to run it on FME Cloud it seems it never gets done. Something that takes 8 seconds in desktop isn't ready after half an hour on Cloud.....seems it never will be. I checked the webconnection and I uploaded the custom transformer both to the repository and to the transformers folder. I run the same version of Desktop and Cloud 2018.1.0.1(18528). It initially didn't accept the custom transformer on an earlier Cloud version. Any ideas to what I might want to check or anyone with simila
Hello,I have a workspace in which I take a lot of data from DB using postGIS reader. Then I try to save it to different files based on fanoutExpression like: output\\@Value(myAttribute).gml In DB I have 20 GB of data so at some point I get out of memory exception. My idea was to first use featureReader to read only myAttribute, then use duplicateFilter and then use FeatureReader with where statement: myAttribute = @Value(myAttribute) but result is saved to file only when all data is read so I get the same: "out of memory exception." Is there any way to:First read all unique myAttribute from given table and then close the connection (because connection timeout may be also a problem) next for each of those unique myAttribute values read data from given table and save to separate file one by one? This way I think that I won't have out of memory or connection timeout exceptions. Thanks for any hints on that!
Hi,I have 2 datasets in my workspace and I want to use "PythonCreator" transformer to create a new feature base on those datasets in my workspace but I don't know how to use workspace datasets in "PythonCreator" transformer. Could you help me?
Has anyone done anything using FME to integrate with PlanGrid. I do not have any direct experience with PlanGrid. But, it appears to be a Project Management software suite specific to Construction. Just interested in any use cases.
I am trying to create a server based tool that will read in multiple files and then process them. At the very beginning I want to prompt the user to select the feature types to read. Specifically, I am reading in MicroStation files using the level names. There can be hundreds of level names so in order to reduce the features being read I want the user to select only those level names they want to process. I see that a private parameter is probably the way to do this, but not sure how that would go. What command would I use to open the schema to select the feature types to read. Will it then pause to allow the user to select what they want and then close the dialog box?
Hi, I have a problem with the fmerest/v3/transformations/submit service and I hope someone can help me. I have a very simple worflow set up in my fme-server process. Creator -> FMEServerEmailGenerator -> TextFileWriterI have set up Topic and Subscription as described and configured my FMEServerEmailGenerator with the right topic. Now I can invoke my process over fme-server gui successfully but if I do it via rest, I dont receive an email anymore. From my understanding the email configuration should be done by the transformer in this case, so sending my necessary published parameters should be enougth:{"publishedParameters":[{"name":"uploadMeasures","value":"No"},{"name":"uploadDailyAverages","value":"No"},{"name":"test","value":"Yes"},{"name":"testEmail","value":"foo@bar.com"},{"name":"DestDataset_TEXTLINE","value":"$(FME_SHAREDRESOURCE_DATA)/output.json"}]}But somehow its not. In my results under request data I'm missing notification manager directives sections. So I had to go
When migrating from 2016 to 2018 I noticed that the folder Templates no longer exists when using a Shared FME Folder (FME Options, Default Path). There is a new folder Workspaces but it isn’t used for templates. Where do I store our company templates on a shared location so they will be visible when creating a new workspace?
Hallo!I have the problem that i have to get every point in a lane to calculate the heading and the distance between this points. But i have no idea how i could get the size of points which are in the lanes and how i get the right coordinates in the right direction (point 1, point 2,...) out of it. I work with an template and tried to give him the lanes, but i couldn't take the nodes one by one to work with them which step i have to do before to give my template just the points/nodes of my line ? the subtemplate-code is:<geometry s="{fme:get-attribute("s")}" x="{geom:get-start-x()}" y="{geom:get-start-y()}" hdg="@atan2(@YValue(),@XValue())" length="{fme:get-attribute("_length")}"> <line/> </geometry>I also give some pictures to show how my template work at least.I hope anyone could help me.
Hi,I'm setting up an attribute containing a list of files, and then I want to use it as input Dataset in a FeatureReader.e.g. the attribute contains the string: "C:\\a.jpg","C:\\b.jpg"The featureReade will reject the attribute as input DatasetIf I hardcode the same string in the FeatureReader Dataset field it works fine.I also tried to use a workspace runner to convert the attribute to a Published Parameter as input for a reader, but the same problem appears. Can anyone help me out?
Hello!I'm working on an fme workbench that are going to be used on fme server. My colleagues are going to draw an polygon and get out all data from postgis database inside that polygon.It should be packed as a geopackage. The workflow is working and I get all the data and attributes without any problems. But the name of the layers are not any good and I need to change this. I want to use an attribute called "name" instead of fme_feature_type as layer name. But If I change this as table name in geopackage it won't run. Any ideas how to solve this?
Hello,I am working on FME desktop 2015.1.1.0 and SmallWorld v4.1.2 software combination. I need to filter SmallWorld data using WHERE clause. When I create a new FME reader and choose Smallworld 4 type, there is no WHERE clause.Should I configure something on SmallWorld or FME side to view WHERE clause or it is not available at all for SmallWorld v4.1.2?Thank you, Slobodan.
I am working on a custom transformer, where one of the input parameters is based on columns in a PostgreSQL table. Initially I wanted to give the user freedom to choose the database connection, schema, and table name... After playing around with the POSTGRES reader I had to realize that the table name seems impossible to alter afterwards - I can live with that.I am still struggling with the list of choices that I want to generate from the database table columns. Is there a possibility in FME to retrieve the column names of a database table before I run a workspace? If one can do that with Python, then that's fine for me, but at the moment I cannot see how to do this. psycop2 isn't part of the Python in FME (afaik) and using FMEs own modules I do not know how to do it.Do I have to use fme.macroValues or can it be done using fmeobjects.getAllAttributeNames? And how to reference the PostgreSQL table in the script?
I have a set of grouped features and want to identify the feature with the highest value in one of the columns, lets call it "MAX_attribute", for each group. I can find the highest value in each group by using the StatisticCalculator. But that only gives me the "MAX_attribute" for the group as an whole, I also need to identify and "tag" the actual feature that had the "MAX_attribute".To give you an example: I have depth readings for a number of lakes, and now I want to find the deapest reading for each lake.I also tried the Aggregator with the ListRangeExtractor but could not make it work as I wished.
I have a polygon shapefile with imagery footprints but with image name blank ('Text') and a point shapefile that has an image name ('Text'). There is no common attribute to link them together but if I use the NaturalSorter transformer on the EntityHand attribute then there is logic how they are linked together. Records 1 and 2 are linked, as are 3 and 4 etc. How do I then group records 1-2, 3-4, 5-6, 7-8 and so on together to conflate the two datasets?
I have a deaggregator transformer in a custom transformer loop. When I run the workspace, the deaggregator holds on to all features until each row has gone through the loop. I am wanting one row to pass through the entire custom loop transformer, all the way, before the next row entering.
I have multiple MicroStation V8i files and need to add an attribute for what category I want to assign to each feature (1.4 million features) based on the igds_level_name. I also have an Excel file that has a list of level name codes and the category assigned to the code. I want to read through the excel file in order and find level names that contain the code. For example, the namecode "TEXT", I want to assign an attribute value of "Annotation" to all of the dgn level names that contain the string "text". ["Annotation" is assigned to a created attribute called Category in the dgn feature.] No information will be overwritten so once a feature has a category assigned to it, it is removed from the comparison, so the order read is important. Hope this makes sense. I thought the InlineQuerier might be the way to go but my SQL is pretty much a novice level.
Hi, I need to add today's date in "Revision Date" section of Meta Data of all the feature classes (which have data) in a geodatabase.
Hi,I´m currently struggling with batch translating .txt-files to more workable .xls-files. For some reason the results seem to differ and can´t figure out why. The only thread I have found & tried to follow on the topic is one Link. I´m currently using FME 2016.1, which may also be a part of the problem. The error/bug seem only to apear on xls-files. Other translations seem to work via a Workspacerunner. For Example attached "Textfix.fmw", that translate Files from "MWD"-format to .txt.Grateful for any Advice on the Topic!Examples belowTranslation with workspace "TXT till XLS_2.fmw"Translation with workspacerunner "Master.fmw"Regards,/Daniel
Hello,Here is my problem: When I tried to add ArcSDE Reader to connect to ArcSDE 10.2.2 database that hosted on Oracle 12c, I got error that below. The error message is so general, I cannot figurate it out where the error come from.
Hey,I'm having trouble removing the _ForceDataType from dynamic outputs in the following flow. The input schema is unknown so the AttributeExposer and than AttributeRemover does not work. So in a xml the _ForceDataType and in a shp _ForceData attribute is present in the output of the writer.The origin of this attribute is the SchemaSetter see below and i use the No setting for this option. The output is set on dynamic schema, same as the attributes.
Hi everyone,I'm trying to run a batch deploy of my workbench but I got this error while the workbench work perfectly in FME.Help needed to fix it !!!5.0| 0.0|ERROR |Geodatabase Error (-2147220655): The table was not found.5.0| 0.0|ERROR |FileGDB Writer: Feature Class 'Hydrographie/Zone_inondable_humide' must exist when Table Handling is set to 'Use Existing'5.0| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details5.0| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details5.0| 0.0|WARN |Geodatabase Error (-2147418113): Unexpected operation.5.0| 0.0|WARN |FileGDB Writer: Could not disable Load Only Mode for feature type ''5.0| 0.0|WARN |Geodatabase Error (-2147418113): Unexpected operation.5.0| 0.0|WARN |FileGDB Writer: Could not free Write Lock for feature type ''5.0| 0.0|INFORM|=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-5.0| 0.0|INFORM|Feature output statistics for `FILEGDB' writer using keyword
Hi, I wonder how i can merge an excelfile with several sheets to an shapefile. The shapefile has the location of stations and in the excelfile I have information aout the stations for each station. i.e each station has its own sheet.I really would lika som help with how i can merge this, please.
I have some road data in ArcGIS SDE database (roads and road signs). Data from the GIS is transmitted to Geo Json with the help of FME. With any changes to the data, I should be able to display the version in the geojson attributes When version changes, the version rises. How can I do that
I'm trying to compare two datasets by looking at the address attribute string used in both datasets and find the fuzzy matching ratios. The read process was fast and read the 350,000 records in dataset 1 and the 14,000 records in dataset 2 in less than a minute. I then sort both lists separately and then use the FuzzyStringCompareFrom2Datasets transformer. I have been running this workspace all day (about 5 hours so far) and it has only output 288 records. Is there a way to speed this up?
Is there anyone who is using FME scheduler to automate SAP jobs? Our company is using SAP ERP software and we want to automate SAP jobs. SAP has its own job scheduler but it lacks many advanced features we are looking for . Like we want the scheduler to run periodic jobs which can ran only on working days with different parameters and dependencies like the next job should start only after finishing the first job ; the second job should run after n +1 days after the first job etc... Some jobs will run on some days but it should have different run date like if it is running tonight , it should populate yesterdays' date as the job date. Can anyone please let me know if FME server has these kind of advanced features to automate jobs?