Creating and organizing workspaces. How to use Workbench.
Recently active
HelloI have to deal with a data versioning issue.Do you know if any tools of data management are available with FME ?What do you advise me to version data according to a software version?Thanks
When delivering workspaces to a customer or a user, I really want the workspace to run without feature caching turned on. With FME 2019.1 the feature caching is turned on by default. Does anyone know of a way to set this behaviour in the workspace file like a worksapce parameter? Issues come when the user want to run the process again, FME 2019.1 is clever and hides the input parameters, however, not all of them. When clicking run again sometimes there is the option to select new data, however, the other options are not there. This results in unexpected behaviour (like dropping a database table instead of inserting into it...oops!) The user actually needs to Re-Run the whole workspace which is also now not the default. I've been getting a lot of support request because of the workspace producing unexpected results. I've also documented it and made it as clear to the customers as I can, however, the issue still comes up with users who are not familiar to FME. I'd really l
I have attribute, that contains mostly 3 street names (there are 1 to 4 street names per attribute).Street names are in finnish, but I would need them also in swedish. I have csv-file that contains street names in finnish and swedishSingle street name would be easily changed with AttributeValueMapper, but how can I change 3 in same attribute?for example "Mikael Lybeckin tie (Kasavuorentie-Bredantie)" => "Mikael Lybecks vägen (Kasabergsvägen-Bredavägen)"This solution is quite close ebygomm Python script
I have a filed like Language and Values as English, French, Italian, Hindi and EtcBut i don't know how many languages are present in that field.Challenge: I would like to export separately for each language.
Hi,Il have to migrate several tables from a mysql database to a postgres database.This seems quit simple but the main difficulty is that the table list to migrate is defined in a specific table and the schema (structure) of all tables to migrate is not known and has to be dynamic.I tried the following:- read the table list with a mysql reader- for each entry in the table list, read the concerned table with a featurereader- send (write) the concerned table in Postgres with a dynamic schema.But this doesn't work, I always have errors:Failed to obtain any schemas from reader 'MYSQL_DB' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information. I tried to change many parameters but never achieve to make it work.I would really appreciate any help.Thanks,Christian.
Hello,I'm facing a new issue with ListKeyValuePairExtractor componant, for some data it encounter an encoding error : Python Exception <UnicodeDecodeError>: 'ascii' codec can't decode byte 0xa0 in position 12: ordinal not in range(128)Traceback (most recent call last): File "<string>", line 30, in input File "<string>", line 118, in get_list_attribute_namesUnicodeDecodeError: 'ascii' codec can't decode byte 0xa0 in position 12: ordinal not in range(128)Error encountered while calling method `input'f_60(PythonFactory): PythonFactory failed to process featureA fatal error has occurred. Check the logfile above for detailsError encountered while calling method `input'f_42(PythonFactory): PythonFactory failed to process featureA fatal error has occurred. Check the logfile above for details I tried a lot of things, encode all attributes on utf-8 or windows-1252, I've try a stringreplacer with this regex ([^\w\S"]{0,2}$). But anyway still the same issue, the job stop on
Hello, I need to use fme server rest api to make a web service application to convert cad to kml. The workspace uses ESRI Reprojector. Now the parameters I publish have no given input and output coordinate system. How do I pass parameter requests to this FMEserver through the web To complete the task
I have source with 10 L count like below I need to select Upto 5L points within source,I have fields like Object ID and ID both are same and those starts with numeric 1.Note: should select from one side
Hi:In FME Desktop 2019.1.3.1, when adding a table using the Oracle Spatial reader, I'm getting some unwanted attributes shown below (starting with fme_geomattr). I am not purposely exposing additional schema attributes. They just show up unwanted. Does anyone know how to avoid having these additional attributes exposed when adding feature types? Thanks!
I would like some quick instruction on how to automate the start of an FMW process. The current FMW uses a series of files that it converts based on date (i.e. the date is in the filename). I need a Python script to be able to load those files into the FMW project once a month and then run the conversion process. I realize that this would be best done using FME Server...but what I'm trying to do is build a "proof-of-concept" for management here (they will see and understand the pitfalls of automating a desktop process to run indefinitely).Thank you
So, I hope I have this right. As far as I can tell, the default behaviour for FeatureWriter is to create any field indices during the CREATE TABLE or ALTER TABLE stage by issuing commands like CREATE INDEX before any features get written.However, this would be against normal mass data append default convention? Writing bulk data against indexed tables can be very slow and in most cases best performance is to create the indices after the data is written. For instance, my FGDB FeatureWriter takes 2 hours to write my current project with the relevant fields set for indexing because every single feature written triggers a resorting of the indices, versus 15 minutes if I leave the field indexing options off.The best workaround I can come up with at the moment is to instead do post writing index creation by manually writing out the the "CREATE INDEX..." statements in the "SQL to run after Write" parameter, but can anyone think of other workarounds or why indices would gen
I'm trying to demonstrate how FME (eventually FME Server) can automate a process for us. I have all of my NMEA data in one folder (they are stored by day in a given month; hence, there can be 700-800 NMEA files in each folder), and I can get the reader to read them all manually...but I would like to know if it's possible to get FMEWorkspaceRunner to automatically read and load all of the files in a folder that will then be converted.The FMEWorkspaceRunner variable is set to: runner = fmeobjects.FMEWorkspaceRunner()I tried to be sneaky and use parameters['SourceDataset_NMEA'] ='\\\\2018ais\\c$\\rawnema\\Feb2019\\*.nmea', but it did not work using runner.runWithParameters(workspace, parameters).I can (of course) do it manually from Python by using runner.promptRun(workspace), but this then defeats the purpose of my Python script.Is there a way to get the FMEWorkspace Runner to automatically read/load all of the files in a folder that will then be converted?When l
Hello, I have a workbench that called children in sequence using FMEServerJobSubmitter transformer.I have a strange behaviour. A job in one branch should finish before another job in another branch starts. My understanding is that the run is sequence should affect only the job in the same branch not in other branches. Why is that the children called from the three different branches of the ETL can not be run in parallel (i.e. at the same time)? Thanks
Hello everyone, I have two datasets:- One of lake polygons,- Another containing the postal code polygons,My goal is to calculate the sum of area occupied by the lakes in each of the postal codes. My problem is not really technical because my workflow works with data samples (when I use an attribute filter on postal codes and I reduce the size of this data set). However, when I launch it with all the data, the workflow always stops at entity number 104. I tried to check in my input file if there was a corrupted data, but that n doesn't seem to be the case. Any ideas ? Thanks !!:)Théo
BonjourJe suis nouveau sur le FME et je voudrais savoir s'il est possible de fusionner plusieurs features classes en un seul.Quel est l'outil que je devrais utiliser. Y a-t-il un document avec les étapes à suivre ou une vidéo indiquant comment le faire?Merci beaucoup pour l'information.
I have a workspace that has a published parameter (selected from a list) that may contain a character with an accent. In desktop this causes no problem.However when running from FME Server the accented character seems to get converted when being run.So when a user selects this:in the log file the command line arguments look like this: Any ideas on what will fix this? ThanksKeith
So, yes I've read about how to get FME 64 bit to run on a machine with 32 bit ArcGIS Desktop installed, but for ease of deployment on different user PCs that will only have the standard ArcGIS configuration, I've opted for 2 workspaces:One to run an extraction of source data with an ArcSDE Reader executing in FME 32 bit. This is due to the dependencies of FME on the bitness of the ArcGIS installOne to transform it by executing in FME 64 bit. The data model is very large and RAM intensive so needs to run in FME 64 bit.FME 2018.1The best solution I can think of it to BAT file this by calling the workspaces against the individual 32 bit and 64 bit FME executable file paths, because I don't think a conventional running them in a Parent workspace with 2 WorkspaceRunners can work, since you can't specify the bitness of the WorkspaceRunners and they would all have to execute as 32 bit or 64 bit inheritted from the Parent workspace mode, but not a mixture of both.But, intereste
Hello! I tried to set a published Parameter in the Python startup script, but the parameter changes just in the dictionary (I think), but not in the workspace. Is it possible to set a published parameter in the python startup script? Here's my Python Code: def ReadParameter(): ParameterFile = open(r'R:\\212_TIM\\Konzept\\TIM_Auskunft\\FME_Migration\\LOG\\ParameterFile.txt','r') for line in ParameterFile: key, value = line.split(' = ') if key == 'CountStart': return int(value) return 'Konnte Id nicht finden' HIS_ID_intern = ReadParameter() d1 = {'HIS_ID' : HIS_ID_intern} FME_MacroValues.update(d1) Thanks for your help! Regards, Isabell
I recently upgraded my FME Server and now when I run jobs using the data download service the zip file returns an unwanted file hierarchy with additional folders named after each Writer in my workspace (e.g. XLSXW2_1 and GEODATABASE_FILE_1), how can I remove these folders?
Hello Team,We have installed FME Server 2019 and published a workbench which was running fine with the FME Server 2015. But in newly installed 2019 server it was throwing following error. oordinate system named NiSource_AE_US_Foot does not exist.2019-12-12 08:49:53| 23.7| 0.0|WARN |Failed to get parameters for coordinate system `NiSource_AE_US_Foot' -- No definition was found for coordinate system `NiSource_AE_US_Foot'2019-12-12 08:49:53| 23.7| 0.0|INFORM|FME API version of module 'GEODATABASE_SDE' matches current internal version (3.8 20190621)2019-12-12 08:49:53| 23.7| 0.0|INFORM|Writer `GEODATABASE_SDE_1' of type `GEODATABASE_SDE' using group definition keyword `GEODATABASE_SDE_1_DEF'2019-12-12 08:49:53| 23.7| 0.0|INFORM|FME API version of module 'GEODATABASE_SDE' matches current internal version (3.8 20190621)2019-12-12 08:49:53| 23.7| 0.0|INFORM|An ArcGIS license is already checked out. The product checked out is 'Advanced'2019-12-12 08:
When creating the reader, I get the following error. I know this driver works because I was able to make an ODBC connection in Excel. I'm using FME 2019 32bit and created the source in a 32bit ODBC Data Source Admin. Error connecting to databaseDatabase Generated Error Information:Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specifiedDatabase SQL Statement Text: SQL State: IM002Variable Information: ODBC 3.x Reader: Failed to connect to database
Hello I 'm tring to set any value to AttibuteManager Transformer as you can see in the attachement. I have created an RandomNumberGenerator to fill a list but it doesn't work. I try also a rand function. Without success. Short, how to set random value in an AttibuteManager Transformer ? (the easiest way ...) Subsidiary question, how to create correct expression with the "text editor_attribute value" ? any help will be welcome.thanks
I want to get this. I upload shp, xls and fmw. Can you give me some idea. Thanks a lot.
I have a range of features e.g. coastlines, country borders each with different attributes. These attributes are currently available in a table under the following structure:Each feature type has a different set of attributes and I can tie the attributes to the geometry using the gsa_shape_set_id.How do I turn this flat table in to attributes dynamically adjusting for the schema of each feature? There are thousands of different features and I don't know the schema before this point.Many ThanksOliver