Using transformers to modify data.
Recently active
I am working on a web application project and will like to include energy consumption, inlet flow and outlet flow, temperature readings visualizations in the 3d model buildings in Cesium
The firs one query is And the second one is Then I need to do a join with this second query and create a list with the results.I dont know if with the SQL Executor transformer I can replicate this two querys. Any idea? Thanks
Long time listener, first time caller.Newish to FME and was attempting to use a user parameter for the first time to allow the user to input the number of days they need to pull data. I have the parameter and the initial formula working fine. DaysPulled is my user parameter: @DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P$(DaysPulled)D),%Y%m%d) The problem I'm running into is later on in the flow I need to use that user input and add a number to it, effectively turning the user parameter into DaysPulled +1 and DaysPulled+2. I've been beating my head against the wall trying to modify DatePulled using add, sum, +1, etc and can't find the right format to get what I need. Example of failed attempt.@DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P@add(1,$(DaysPulled))D),%Y%m%d) Can anyone point me towards a solution?
How to download and save multiple DTM zip files from CSV with URLs. Need help with settings for extracting individual files
I have a workspace in FME Workbench 2022.2 that reads an ESRI ArcGIS Server Feature Service containing 7 layers. It successfully reads all 7 layers and transforms them to the appropriate feature types. That same workspace in FME Form 2023.1.1.1 is able to read in the number of features for all 7 layers but only able to successfully read in the features for 3 of the 7 layers. On the 4 layers that fail it appears to be failing after the first batch of 1000 records are requested. As a test I created a new project with only the FeatureServer reader in FME Form 2023.1.1.1, again same problem. As another test I tried using the MapServer endpoint for the service rather than the FeatureServer endpoint that failed on the 4 layers. This successfully read in all 7 layers.ArcGIS Feature Service Reader: Got 4222 results for layer/table ID 0ArcGIS Feature Service Reader: Splitting reading of 4222 features into 5 batches of up to 1000 featuresArcGIS Feature Service Reader: Getting feature results 0
I created a primary key using SSMS for the new table but I still get the error the layer does not have identity properties.
I sometimes have to read from multiple readers. Is it possible to set the maximum features to read to ALL feature types? Not just all per reader? Related, is it possible to set the Search Envelop for ALL readers?
Hi All, I'm trying to create a workflow that iterates through a folder which contains individual GDBs (e.g. 20 individual GDBs) and then merges the Feature Classes with the same name into a new blank GDB.Any idea how to make that happen?Thanks 🙂
Hi, I have 2 data sets (shape-files). A point dataset with 3d-points or at least points where the elevation is stored in an attribute field (different data quality) and a polyline dataset with 2d-lines whose vertices are identical to the points from the point dataset. Is there a way to assign the elevations from the point datasets to the line vertices and then create 3d polylines from them? Thanks for your help
I have a very simple workspace that just tests whether a string has a “.” Or a “:’ in it and if it does then these characters are deleted. I am using the Testfilter to test for the characters, and then a stringreplacer to delete them and then I must make sure the string is all caps. Is there a way to do these three operations by using the String Functions in the Testfilter? I haven’t been able to figure out how the string functions work. Also, will using the string functions speed up the translation? I have 47 million records to test and right now it takes 4 hours to run. I am using FME2018. I have included the workspace and source CSV file. Thanks.
In the writers, under user attributes we can see the table with name, type, of data, width., etc. Is there a way to copy/pate or export this table in csv? I am tasked with data type for multiple outputs, and it would be great not to do so manually.
We are attempting to use the Automations > Manage Automations as a built-in user, but when browsing to that page it is blank and there are no automations in the popup list. We've made the user a member of 'fmeadmin' and 'fmesuperuser' but it makes no difference. So far only the 'admin' account is able to Manage Automations.What are the minimum permissions required for users to make this work?
I have a feature class with a single feature that I need to convert to a multipolygon type geoJson file. I'm not super familiar with geoJSON, and I'm being told this is a hard requirement. How does one create a multipolygon geoJSON file from a single feature?
I have FeatureReader transformers within my workspace that are configured to read features from an Excel file. The name and path of the Excel file are variables provided by parameter values, but the Excel sheet name is always the same. The schema of the file is likely to vary every time the workspace is run. I'm really struggling to get any features to read in, and am a bit unsure of where I'm going wrong. From similar posts in the past (eg; https://community.safe.com/s/question/0D54Q000080hdRJSAY/how-to-expose-attributes-from-featurereader-if-feature-type-is-dynamic) it seems that what I'm trying to do potentially isn't possible without scripting something bespoke in a PythonCaller, but it really seems like something that FME should be able to do. Does anyone have any advice or a working methodology for this sort of problem? Thanks in advance
I have two tab files and while joining them I get this error for one of the row ERROR |FeatureJoiner (FeatureJoinerFactory): The UTF-16LE string 'DOÃƑ±A ANA-HILL' could not be converted to the encoding: windows-1252.
Hello,I have a SQLExecutor connecting to my SDE on a SQL database. I am using the Microsoft SQL Server Non-Spatial Format with an embedded Connection. My SQL Statement is:FME_SQL_DELIMITER ; GO DISABLE TRIGGER gisowner.SEGME_MSLINK_COUNTER ON gisowner.[a10]; GOI get the following errors:Query failed, possibly due to a malformed statement.Provider error `(-2147217900) Incorrect syntax near the keyword 'TRIGGER'.'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'AHS_GIS' using the 'MSSQL_ADO' reader
I have a gdb with polygons ( multipolygons). I read polygons and simply write to a new gdb and my polygons holes are filled? It happens also while reading Isee. As if there is a geometry validation happening. How can I stop this? It is really annoying.
Hi, I need some help setting a basic test with the tester transformer. I'm trying to fail rows from a feature if they match any values in a csv file I've added as a reader. I'm having some issues getting things configured correctly. So something like NOT @Value(field) Contains <Right value>. But I can't seem to connect the right value. Connecting the csv as an input isn't what I want, but I cant figure out the syntax to use in conjunction with '$(SourceDataset_CSV2)'. Sorry for this basic question but I couldn't figure this out looking at the documentation. Thank you.
The first dataset has 10500 objects ( a table with x,y id, date,etc. etc.)The second dataset 7000 object s )(a table with x,y,id ,,date, adress etc.etc.)Based on the x and y we would like to get a combined file as a result.Where all 10,000 objects from the first dataset are located at the closest object to an address point.A list of these.. It seemed logical to us to use the transformer neighbor finder for this. But this doesn't work. ideas more than welcome Johan
I have a map that has 5 layers in it and want to have them all displayed using different symbology in the HTML Layouter but I can only define a single colour for the layer.Is it possible to generate HTML output with a little more cartographic input for each incoming layer?
Hi. I have a workspace that is using the Micostation DGN (v8) reader that's reading files from a Projectwise URL collection. It's currently reading four dgn files successfully however when trying to add other I'm getting an error message. Failed to obtain any schemas from reader 'IGDS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationWorkspace generation failed. Parameter file was C:\\Users\\{USER}\\AppData\\Local\\Temp\\FME_1701131211957_17128 I've tried opening the files in a clean workspace and even rebooted my machine to rule that out. The same message persists. Within the reader I'm "Grouping Elements By Scheme - Level Names"and selecting "Preserved Names Cell Insert Points". I also assign a coordinate system to the dataset. Are there any suggestions about how I can overcome this, or will I need to go and have a chat
Hi, I know this has been partially answered here but it doesn't quite answer my exact issue.I'm trying to use FTPCaller to download a file from an SFTP site but get the error 'Failed Initialisation'. FME will create the target file fine but with no data in it, and with the above error.I have tested FTPCaller on other SFTP sites and it works fine. I can download the file using Filezilla and I can also get the file download to work using the SystemCaller transformer to run a batch file which runs PuTTY (using a PSCP comand line). All with the same credentials.All file permissions appear to be setup fine and I've tried changing every parameter in the FTPCaller with the exception of SSH-agent/Pageant authentication. Having already got it to run with PuTTY I didn't see any advantage to going down this route.I'd really like to be able to do this directly with FME and not involve a third party package such as Pageant or PuTTY. Is this possible?Thanks in advance,J
Hi everyone, I'm trying to set up a model that will allow the user to select from a list of feature services to read from. I've got a Choice user parameter set up but whenever I try to run the workspace I get this error:I'm very confused since the service connection is working just fine and the feature reader will read in normally when I directly reference a specific service. Help a noob out?Thanks, Brian