Using transformers to modify data.
Recently active
I have a workspace that was just pulling data and joining schema from two feature classes from an enterprise geodatabase. Then, we had a business need to add two new fields to the output feature class. (I cannot add them to the input feature class). Now, when I run the workspace, it overwrites the edits to those two new fields. Does anyone have suggestions on how to set this up in FME so that the two new fields (flagged and flagged description) aren't overwritten? Here is a screenshot of the workspace. Thanks!
Working Key: 1472_3_81445Not Working Key: 1472_E2b_81445
Python = np.cross(XYZ, ABC) ????
I am working on a web application project and will like to include energy consumption, inlet flow and outlet flow, temperature readings visualizations in the 3d model buildings in Cesium
The firs one query is And the second one is Then I need to do a join with this second query and create a list with the results.I dont know if with the SQL Executor transformer I can replicate this two querys. Any idea? Thanks
Long time listener, first time caller.Newish to FME and was attempting to use a user parameter for the first time to allow the user to input the number of days they need to pull data. I have the parameter and the initial formula working fine. DaysPulled is my user parameter: @DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P$(DaysPulled)D),%Y%m%d) The problem I'm running into is later on in the flow I need to use that user input and add a number to it, effectively turning the user parameter into DaysPulled +1 and DaysPulled+2. I've been beating my head against the wall trying to modify DatePulled using add, sum, +1, etc and can't find the right format to get what I need. Example of failed attempt.@DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P@add(1,$(DaysPulled))D),%Y%m%d) Can anyone point me towards a solution?
How to download and save multiple DTM zip files from CSV with URLs. Need help with settings for extracting individual files
I have a workspace in FME Workbench 2022.2 that reads an ESRI ArcGIS Server Feature Service containing 7 layers. It successfully reads all 7 layers and transforms them to the appropriate feature types. That same workspace in FME Form 2023.1.1.1 is able to read in the number of features for all 7 layers but only able to successfully read in the features for 3 of the 7 layers. On the 4 layers that fail it appears to be failing after the first batch of 1000 records are requested. As a test I created a new project with only the FeatureServer reader in FME Form 2023.1.1.1, again same problem. As another test I tried using the MapServer endpoint for the service rather than the FeatureServer endpoint that failed on the 4 layers. This successfully read in all 7 layers.ArcGIS Feature Service Reader: Got 4222 results for layer/table ID 0ArcGIS Feature Service Reader: Splitting reading of 4222 features into 5 batches of up to 1000 featuresArcGIS Feature Service Reader: Getting feature results 0
I created a primary key using SSMS for the new table but I still get the error the layer does not have identity properties.
I sometimes have to read from multiple readers. Is it possible to set the maximum features to read to ALL feature types? Not just all per reader? Related, is it possible to set the Search Envelop for ALL readers?
Hi All, I'm trying to create a workflow that iterates through a folder which contains individual GDBs (e.g. 20 individual GDBs) and then merges the Feature Classes with the same name into a new blank GDB.Any idea how to make that happen?Thanks 🙂
Hi, I have 2 data sets (shape-files). A point dataset with 3d-points or at least points where the elevation is stored in an attribute field (different data quality) and a polyline dataset with 2d-lines whose vertices are identical to the points from the point dataset. Is there a way to assign the elevations from the point datasets to the line vertices and then create 3d polylines from them? Thanks for your help
I have a very simple workspace that just tests whether a string has a “.” Or a “:’ in it and if it does then these characters are deleted. I am using the Testfilter to test for the characters, and then a stringreplacer to delete them and then I must make sure the string is all caps. Is there a way to do these three operations by using the String Functions in the Testfilter? I haven’t been able to figure out how the string functions work. Also, will using the string functions speed up the translation? I have 47 million records to test and right now it takes 4 hours to run. I am using FME2018. I have included the workspace and source CSV file. Thanks.
In the writers, under user attributes we can see the table with name, type, of data, width., etc. Is there a way to copy/pate or export this table in csv? I am tasked with data type for multiple outputs, and it would be great not to do so manually.
We are attempting to use the Automations > Manage Automations as a built-in user, but when browsing to that page it is blank and there are no automations in the popup list. We've made the user a member of 'fmeadmin' and 'fmesuperuser' but it makes no difference. So far only the 'admin' account is able to Manage Automations.What are the minimum permissions required for users to make this work?
I have a feature class with a single feature that I need to convert to a multipolygon type geoJson file. I'm not super familiar with geoJSON, and I'm being told this is a hard requirement. How does one create a multipolygon geoJSON file from a single feature?
I have FeatureReader transformers within my workspace that are configured to read features from an Excel file. The name and path of the Excel file are variables provided by parameter values, but the Excel sheet name is always the same. The schema of the file is likely to vary every time the workspace is run. I'm really struggling to get any features to read in, and am a bit unsure of where I'm going wrong. From similar posts in the past (eg; https://community.safe.com/s/question/0D54Q000080hdRJSAY/how-to-expose-attributes-from-featurereader-if-feature-type-is-dynamic) it seems that what I'm trying to do potentially isn't possible without scripting something bespoke in a PythonCaller, but it really seems like something that FME should be able to do. Does anyone have any advice or a working methodology for this sort of problem? Thanks in advance
I have two tab files and while joining them I get this error for one of the row ERROR |FeatureJoiner (FeatureJoinerFactory): The UTF-16LE string 'DOÃƑ±A ANA-HILL' could not be converted to the encoding: windows-1252.
Hello,I have a SQLExecutor connecting to my SDE on a SQL database. I am using the Microsoft SQL Server Non-Spatial Format with an embedded Connection. My SQL Statement is:FME_SQL_DELIMITER ; GO DISABLE TRIGGER gisowner.SEGME_MSLINK_COUNTER ON gisowner.[a10]; GOI get the following errors:Query failed, possibly due to a malformed statement.Provider error `(-2147217900) Incorrect syntax near the keyword 'TRIGGER'.'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'AHS_GIS' using the 'MSSQL_ADO' reader
I have a gdb with polygons ( multipolygons). I read polygons and simply write to a new gdb and my polygons holes are filled? It happens also while reading Isee. As if there is a geometry validation happening. How can I stop this? It is really annoying.
Hi, I need some help setting a basic test with the tester transformer. I'm trying to fail rows from a feature if they match any values in a csv file I've added as a reader. I'm having some issues getting things configured correctly. So something like NOT @Value(field) Contains <Right value>. But I can't seem to connect the right value. Connecting the csv as an input isn't what I want, but I cant figure out the syntax to use in conjunction with '$(SourceDataset_CSV2)'. Sorry for this basic question but I couldn't figure this out looking at the documentation. Thank you.
The first dataset has 10500 objects ( a table with x,y id, date,etc. etc.)The second dataset 7000 object s )(a table with x,y,id ,,date, adress etc.etc.)Based on the x and y we would like to get a combined file as a result.Where all 10,000 objects from the first dataset are located at the closest object to an address point.A list of these.. It seemed logical to us to use the transformer neighbor finder for this. But this doesn't work. ideas more than welcome Johan
I have a map that has 5 layers in it and want to have them all displayed using different symbology in the HTML Layouter but I can only define a single colour for the layer.Is it possible to generate HTML output with a little more cartographic input for each incoming layer?
Hi. I have a workspace that is using the Micostation DGN (v8) reader that's reading files from a Projectwise URL collection. It's currently reading four dgn files successfully however when trying to add other I'm getting an error message. Failed to obtain any schemas from reader 'IGDS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationWorkspace generation failed. Parameter file was C:\\Users\\{USER}\\AppData\\Local\\Temp\\FME_1701131211957_17128 I've tried opening the files in a clean workspace and even rebooted my machine to rule that out. The same message persists. Within the reader I'm "Grouping Elements By Scheme - Level Names"and selecting "Preserved Names Cell Insert Points". I also assign a coordinate system to the dataset. Are there any suggestions about how I can overcome this, or will I need to go and have a chat