Creating and organizing workspaces. How to use Workbench.
Recently active
I have simple workspace routine that imports data collated from ArcGIS Survey123 (AGOL) and updates to a SQL server table that needs to run on a daily basis. Can this be done with a batch file (.bat) and scheduled with windows task scheduler?
I have a Microstation v8 file that has 60 odd levels from which I have to filter out 20 and further filter those 20 levels to based on the color of the features. One level has features that go on two different output levels. I am using an Attributefilter to filter them out based on their color value, then use several FeatureCreators to write out the features with the destination color, weight to the destination levels. When I look at the log it shows that features were created for two destination levels, but when I open the dgn file I see no features on one of the destination levels. All output features will be written on a single level. Any idea why?
@david_r @DanAtSafe I've created a simple workspace to download a file from FTP every morning. When I run the workspace in FME -> everything works.When I run the FME workspace from the command line -> everything works.When I run the batch file that I created, which points to the FME workspace -> everything works.When I create a task in Windows Task Scheduler to run the batch file that I created, which points to the FME workspace -> Task Scheduler says it completes successfully, but no files are downloaded or saved.Additionally, I added a function (at the end of the batch file that launches the FME workspace), in order to create a simple log file called "batch_log.txt":C:\apps\FME_18440_x64\fme.exe "J:\workspace.fmw" echo "this works" > C:\apps\Scratch\batch_log.txtWhen I run the batch file from the CMD prompt successfully (not Task Scheduler), the log file contains this:FME 2018.1.0.0 Beta (20180319 - Build 18440 - WIN64)FME ESRI Edition (node locked-crc)Permanent Licens
Hi,Does anybody have any experience with FME and SQLBase?FME doenst support it, but can an ODBC connection can be made?Thanks,Itay
To simplify this issue, my short term goal is to build a simple module which checks each attribute from a transformer or reader and returns the percentage of nulls for each attribute (vs the total number of records). for instance something like: Input: Attribute1Attribute2Attribute3Attribute4...... Output: Attribute1Attribute1-null-countAttribute2Attribute2-null-countAttribute3Attribute3-null-count......or something like that... Again, to clarify, we DO NOT KNOW the Attribute names nor how many attributes there will be. Ideally, I would build a Custom Transformer, which accepts an unknown number of attributes and performs this calculation / process. However, Custom Transformers require that the inputs attributes are static. From all the research Ive done I cannot figure out any way to make this happen. I thought about a transformer that takes all attributes and combines them into one then they could be broken apart after but nothing seems to exist. I am open to any suggestions eve
Hi,I have many tables in SQL Server under the 'dbo' schema that I would like to replicate to PostGIS under an 'sde' schema. I would like to do this using the dynamic schema functonality. How can I replace the dbo with sde in the fme_feature_type attribute while still bing able to associate the matching schema for the tables using the dynamic writer.Thank youOliver Please forgive the use of schema term - schema in sql server means something different to schema in FME.
I am 2 feature reader in My WS , to read a PostGIS DB , we update the data in post GIS but when we inspect the featured reader it still sees the old data.we did a test in a new workspace and its working fine.is there any setting we need to handle Thanks
Hi.I like to have most of the essential translation parameters as published. This typically includes the database server name and the database name when working with (MS/SQL) databases.But when I press the "..." next to the current value to choose another, I get an unexpected error, stating that I gave an "Invalid authorization specification", even though I've set it to "Windows Authentication" originally, which worked then.I cannot specify any other "authentification", so I'm left with having to write the database name manually. Not cool, and not very productive. And I cannot change the parameter into a choice list either.Is there another way to get this to work ?Cheers
Hi FME Experts, I have F.C and we received new data for the same F.C it contains 3 types of update:- update on the attribute level.- Update on the geometry level.- Add new data.I am trying the insert the new data into the main destination, I tried the update\\insert feature operation with truncate data but it does not work.there is a way to do this?
Just trying to make a variable input parameter with a Slider in FME 2017 (Build 17271) and it's not on the list of the Parameter types.Anyone knows where is it gone and how to create one?
Hi community,We run into the problems that certain jobs on FME Server fail become the underlying database can not be reached (temporarily). We are looking into the causes of this. In the meantime I am looking for a way to automatically resubmit the failed jobs after a certain time, e.g. retry after 30 minutes and perhaps retry a couple of times, rather than having to manually resubmit the failed jobs by the FME Server administrator.Is there a way to do this?Thanks,Joep Luijten
I have reviewed the workbench provided in this link(https://knowledge.safe.com/articles/73933/converting-arcgis-indoors-data-to-imdf.html?childToView=86665#comment-86665). Are there any additional steps that need to be taken for generating the imdf? The workbench was able to read openings but none of the other gdb features were getting read.
Hi there,I have some data where one column is only sparsely filled, and I want to fill these missing ones based on another present attribute. Here's a basic representation:ClassTypeMammalDog DogFishTrout Trout TroutReptileLizard Lizard What I need to do is fill in all the empty "Class" lines based on the "Type". In the data, each Type will always have at least one entry in Class (aka, no Type will ever be classless), and no Type will have more than one class.So in short, my current data may have 3 entries with "Trout" and only one of those specify the class as "Fish". What I want is to derive the info from that one Type entry, and fill in all the blank Class lines. Thanks in advance for any tips! Best regards,
Hi,I would like to use a python caller to compare the files (and their size) that are located between two folders. My idea will be to used a python caller that will give me the list of the filenames for each folder and then used a Featuremerger to compare the two lists of files name by name and size by size.Any ideas?Arthy
I have a workspace that produces statistics from some survey data and then writes a finished report as a Microsoft Word document. However I am having some issues.Firstly, there seem to be FME system attributes being passed through to the final report. Namely, "fme_feature_type" and "fme_type" (see image 1 - highlighted rows). These aren't selected in either the writer or reader Format Attributes tab, and I have tried a number of ways of removing them including using Attribute Managers, Removers, Keepers & Testers. The problem is they aren't showing up at any stage of the workflow, except in the final output report. IMG 1 Secondly, I am having trouble with ordering data within a table as required. I pass the relevant attributes through to an Attribute Manager, sort them as I need (image 2), and then pass them to a MS Word Styler and a MS Word writer. However, they are then sorted differently in the final report (image 1). I can't work out how to sort
Hi,I use a FME Server 2016 to run different workbenches. For the update on FME Server 2018 I have to upgrade these workbenches, too. In one workbench I use the custom transformer LineDivider from Takashi Iijima.After the upgrade I have the problem, that the output of the upgrades workbench is less than the output of the old workbench.old outputnew outputEspecially the PythonCaller has an other output. But the old and the new workbench should have the same size.Has somebody an idea which parts of the PythonCaller has changed? Thanks and best regards
Hi, I wish to segment a line geometry at the buffer extent. I.e. The buffer centroid is an intersection of lines, and I wish to segment all connecting lines, so that they all have the same length around this node. Thank you for your help, I am a beginner at FME.
I need to compare file sizes and other attributes for a PRE upgrade and POST upgrade output files. O would like to get the list of files from both folders and compare the sizes, names and type. I am new to python and really need help writing a python script.
I am using the FME Httpcaller to get data from an API. There is an issue with the API and some of the calls are rejected with a 404 Not Found Error. I am using the Error logging option in the FME translation but i wish to exclude this particular error. Is there any way to exclude certain errors from being logged in the Error log in FME?
Hi,For each feature in my dataset, I have two lists: one containing labels and one containing values.label{0}: IDlabel{1}: Namelabel{2}: Typelabel{3}: Countryval{0}: 1val{1}: Groningenval{2}: Placeval{3}: The NetherlandsThere may be more or less items in both lists. The contents of `label` may be completely different. But `label` and `val` always have an equal number of items.How can I dynamically create attributes from these lists, with the contents of `label` as attribute names and `val` as attribute values?
It's slower on the machine that is supposed to be faster!
Hello,FME 2017.1.1.1 build 17652, 2017.1.2 beta build 17717, 2018.0 beta build 18208The scenario is:The source dataset contains multiple feature types. e.g. "A", "B", and "C".Read every feature from the source dataset and simply write them into Shapefile files for each feature type separately, with the same schema as corresponding source feature type.Here, the destination dataset (folder) names should be the same names as the source feature types. i.e. "A", "B", and "C".And all the destination files (feature types) should have an identical name. e.g. "output.shp"In fact, the names and schema of source feature types are unknown when creating the workspace, so you want to configure Dynamic Schema and Dataset Fanout.It's easy to realize this using FeatureReader + regular Shapefile writer with Dynamic Schema setting and Dataset Fanout configuration. However, I was't able to realize this with a FeatureWriter. Acco
Dear All,I have three workbenches,First one is for taking backup data and Second one is to check the value of one field with two cases and published in FME server.Third workbench is for to run above workbenches in sequences using FMEServerJobSubmitter transformer.My query is second workbench Status attribute value need to bring into Third Workbench when second workbench failed through FMEServerJobSubmitter Failed port.Please advice to achieve this task.Second workbenchThird WorkbenchThanks in advanceVenu
Hi all,Firstly I found this post: https://knowledge.safe.com/questions/5094/create-column-names-from-column-values.htmlBut it hasn't answered my question fully.I have multiple shapefiles containing points. Each point has a VALUE field and a unique ID field which is the same across all the shapefiles. The end goal is to create a spreadsheet with the unique ID field and a field name containing the date of each shapefile populated with the VALUE field. The name of the shapefile contains the date so I am using substring extractors and a concatenator to build the date.I followed the guidance in the previous question and am using an attribute creator to create the date field and populating it in the same stepAnd an attribute exposerHowever, when I run the workspace and the date field is not created properlyBut it is contained within FMEI tried writing to a spreadsheet, but the output was the same as the data inspector table view. As in it didn't create the field 18/05/2017, but it di
Hi all,I try to access the GDAL library via python to use a format (namely esri personal geodatabase) which my FME installation / licencing doesn't support. GDAL 2.4.0 and Python for GDAL are installed (everything under 32bit as my Microsoft Access driver is a 32bit installation, according to the manual https://sandbox.idre.ucla.edu/sandbox/tutorials/installing-gdal-for-windows). In my Command Prompt everything works, except the connection to a *.mdb. The error says:ERROR 1: Unable to initialize ODBC connection to DSN for DRIVER=Microsoft Access Driver (*.mdb);DBQ=PGeo:electricite.mdbIf you have any advice on this, I'm grateful. Of course I'm checking my drivers, but couldn't find any inconsistencies yet.Well, my main problem is to access the GDAL library within FME PythonCreator. How do I import it? I triedfrom osgeo import gdalbut this doesn't work. Do I miss something?Cheers, Maria