- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form

FME Form

A space to discuss FME Form

27560 Posts

Recently active

Most replies Most views Newest first

jokerfmeContributor

asked in Data

Writing Data into an Arcsde Geodatabase ?

Hello , this is my first post , and I hope to receive an answer I have in FME an ESRI license that allows me to read from and write to an Arcsde geodatabase . I'm interested in knowing if anyone has successfully edited specific feature classes , made modifications in a workspace (such as adding data , deleting data or moving points to new positions), and then writed the output back to the the same feature classes after editing by ArcSDE geodatabase writer.After editing and modifying the data, I understand that in ArcMap, data typically undergoes compression, tracking which data is added and which is deleted.Is it possible to write the output directly to these compression tables ? Is this step necessary to do by FME ?Second question : about writing into Relationship classes I read an article https://support.safe.com/hc/en-us/articles/25407490028813-Writing-Geodatabase-Relationship-Classesthat uses an XML workspace as a template for writing to relationship classes, but I didn’t f

FME server workspace not sending emails as failing to find attachment

Keeping getting the following error message - Overdue_Emailer: The file 'C:\\ProgramData\\Safe Software\\FME Server\\repositories\\GIS\\Test send Email/Overdue.xlsx' could not be found. It is required to form the content of the attachment Overdue.xlsx Works space created in workbench and published to server. Works fine if a run from workbench and I can see the .xlsx files that are the attachment in fme server repository but still getting an error

715

22 days ago

rzel24Contributor

asked in Authoring

FTPCaller in FME Flow

Hello,We are using FTPCaller to connect to our SFTP Server via OpenSSH Agent as per the instructions in this article:https://support.safe.com/hc/en-us/articles/25407554321805-Using-a-Private-SSH-key-with-FTPCaller-to-Authenticate-an-SFTP-Connection-for-FME-Form-and-FME-Flow-on-Windows-Systems The authentication is not a problem and we are able to log into the SFTP server, but we are having problems downloading files with spaces in their names, we are trying to download a file named:LB Daily Course Raitings_202409130404.csv the URL set up in the FTPCaller is:sftp://sftpip:2222/Test_Folder/LB Daily Course Raitings_202409130404.csvWe keep getting the error that the file does not exists, we know the issue is dealing with the spaces, and have tried downloading a files without spaces and it works fine. We’ve also tried all sorts of scape options to cancel the spaces in the URL but we get the same error indicating the file does not exists.We’ve also tried to use LB*.csv as the name but same e

130

22 days ago

jacklonsdaleContributor

asked in Data

Excel Reader showing formula values as missing

Hi all,As part of a development of some routines, I have created a many tab excel file where i inserted Formulae using the AttributeManager and the Cell.Formula naming convention. Due to the nature of the VLOOKUPS i used (dynamically i suppose), i could not do this calculation in FME's Arithmetic Editor.Opening the excel sheet shows the values i do want, given by the formula in the cells. However, when i now come to read this sheet in my next routine, the values are all shown as <missing>. Has anyone encountered this before or have any ideas?Thanks all, kind regards,Jack

8913

22 days ago

fme_nerdContributor

asked in Transformers

Custom Coordinate System

Hi all,I have created a custom coordinate system and placed it in the FME documents directory but I can’t access that in CSMapReprojector transformer. Has anyone dealt with this issue? Looking forward to your responses. Thanks

292

22 days ago

timboberooskyContributor

asked in Data

How do I handle possible errors when writing multiple feature types with post data processing

I’ve alluded to my question on a few other posts about FeatureWriters:When FeatureWriter fails there is no output | CommunityAdd a Rejected port to FeatureWriter | CommunityBut figured I’d ask a more directed question in its own posting. I’m in a situation where I want to do some post-processing after writing data to each of my 40 feature types. I have a FeatureWriter for each feature type, in an attempt to catch and do no post-processing for feature types that fail, but continue with post-processing on feature types that write successfully. I’ve come to realize that any FeatureWriter that fails, stops the entire workspace. Setting “Rejected Feature Handling” to “Continue Translation” doesn’t apply to a failed FeatureWriter. The “Rejected port” link above is suggesting adding such a port to the FeatureWriter, which would solve my predicament, at least as I understand it, but it’s not implemented as of FME 2024.1.1, and I don’t know if there are plans to do so. I’ve also tested out sett

254

22 days ago

jugoslaviaaSupporter

asked in Transformers

Geometry Missing in Clipped Output when Writing to GeoPackage in FME

I am working with a table from a GeoPackage in FME, reading it and clipping based on intersections between categories. When writing the output, the unclipped parts are successfully written to Writer 1 without any issues in the output GeoPackage. However, the clipped parts are written without geometry, even though I can see the attributes correctly in the visual preview on the attribute expose just before writting. I'm confident that I’ve set the geometry type correctly in the writer. What could I be missing here?

Does the new version of Form support ESRI's new Date (only) or Time (only) formats?

Curious if the new version of Form, 2023.2.1.0 will support ESRI's new Date (only) or Time (only) formats? They are not appearing for me when connecting AGOL, but they appear when I connect to a FILEGEODATABASE.

675

23 days ago

robert_puntContributor

asked in Data

create time segments

Hello, i have a question for a scanner. the scanner drive through our city. the scannner makes a couple of rounds per day. But i have many record with a timestamp. between the rounds there is a time diffrent say 1 hour or more. how can i crerate a round number that the scanner makes.for example the scanner start at 7.00 en ends at 10.00 (thats round 1) and then starts at 13.00 and ends at 16.00. (thats round 2) the next day is somewhat the same but the count must go on. Beste Regards Robert

587

23 days ago

goldsteinContributor

asked in Transformers

How to make Emailer to stop sending empty files

Hi Community,I have FeatureWriters creating log text files for me depending on various conditions.If the conditions are not fulfilled the files are still generated but empty and emailer still sends those empty files as attachment.How can i stop this from happening, so that only the log files with any values are sent as attachments with email.Thank you

426

24 days ago

eshirinyan

asked in Transformers

HTTP Caller and renaming of response files on-the-fly

Hi,I use a CSV list with standard ArcGIS server queries + HTTP Caller to get geojsons. a CSV list contains also layer names etc. I use the File option when saving a response because I need a separate geojson file for every query. Everything goes great, however response files look like "http_download_153028689823_5840.json" which is hard to deal with. Actually I can create a folder with a layer name but I would like to have an option to save a response file itself with a meaningful name and keep granular file structure. Ideally I see it as follows: I run a query within my CSV then get some attributes from the same CSV and supply a response filename from HTTP Caller with these attributes on the fly.There is a way to deal with a new Workspace and rename all the files using filecopy (upd - today I have finally managed with DatabaseJoiner for this purpose), but I am interested in a more integrated solution. Thank you in advance!Evgeny

746

24 days ago

f.kemminjeContributor

asked in General

Can FME do the postman application job(http request) ?

Hi Team,I am using the following xml snippet (thru postman) to get the response and i get the response from postman. it is working good. Now the same thing i need to achieve thru FME. Please help me on what transformer to be used? and how can i pass the parameters?can httpcaller do this? i tried with http caller using GET methos but Response is NULL. <soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:test="http://www.synchronoss.com/spatialSUITE/test"> <soap:Header xmlns:wsa="http://www.w3.org/2005/08/addressing"> <wsa:Action>HubTraceB7</wsa:Action> <wsa:To>http://gisstrm-po-c2p.cable.comcast.com/trainingSTORM/spatialSUITE/v7_1_0/ws-i/HubTraceB7</wsa:To> </soap:Header> <soap:Body> <test:TestRequest> <test:Action>echo</test:Action> <test:Parameter>CB10995066|Incoming|CB10995070_1</test:Parameter> </test:TestRequest> </soap:Body> </soap:E

624

24 days ago

marta.podsiadSupporter

asked in Data

xml does not open

Hi, I have downloaded data from WFS (GML) as xml (attached). It shows the location of a parcel. However, I am struggling to read information in FME and create a polygon representing parcel.I tried to read it as:OGC GML (Geography Markup Language)OGC GML SF-0 (Geography Markup Language Simple Features Level SF-0 Profile) I am getting this error XML Parser error: 'Error at file: 'C:\Users\MPODS\AppData\Local\Temp\FME_XSD_CACHE\fmexsd_1729842858321_34548.xml' line: 1 column: 1 message: invalid byte '‰' at position 1 of a 1-byte sequence'An error occurred while attempting to parse the XML Schema document 'C:\Users\MPODS\AppData\Local\Temp\FME_XSD_CACHE\fmexsd_1729842858321_34548.xml'The XML Module halted on error, see the logfile for detailsAn error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'GMLSF' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile

7410

24 days ago

thomastupuivaoContributor

asked in Data

using 1st row for column header for a variety of text files

I have a request to build a FME workspace that can read a text file and load it into an Oracle database with the filename with a suffix appended as the table name (ie. filename_ext).That is fine, the problem is the column headers and fields will differ, depending on the filetype (file A might have 10 columns, file B will have 17 and the column names will be different between A and B)I’ve considered using a tester that directs the flow to an attributemanager based on a “user parameter”. This becomes problematic if the source text file changes column structure or an additional file type (file C, D and E) is introduced.Is there a way for the text file to be read (as generic in the featurereader), have the attributes exposed, split and output with the 1st row as the column headers. Ideally without having to know the column names prior.Thanks Thomas

412

24 days ago

dor1411993Contributor

asked in Data

Error with reading Pipe and Structure Data Fields (Attributes)

Hello FME Community!I’m trying to read a Civil 3D file in FME, but I’m not able to access the specific attributes I need.I'm trying to retrieve Pipe and Structure Data Fields (Attributes), but I'm running into errors. Here are the errors that I’m seeing:```2024-10-27 15:13:47| 5.1| 0.0|ERROR |AutoCAD Reader: An error occurred for dataset 'C:\Users\Dor\OneDrive\Perach\Ayalon\חומר ראשני\R6407_01-RME-DR-SVD.dwg', in function AutoCAD2004Reader::readC3DSchema. Exception thrown: 'Not that kind of class' (Object of class AcDbProxyObject can't be cast to AeccDbNetworkPartDef.)2024-10-27 15:13:47| 5.1| 0.0|ERROR |An error has occurred. Check the logfile above for details2024-10-27 15:13:48| 5.6| 0.0|ERROR |Failed to obtain any schemas from reader 'CIVIL3D' from 1 dataset. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information.2024-10-27 15:13:48| | |ERROR |Workspace generation faile

240

25 days ago

larueContributor

asked in Authoring

Inconsistent Format When Writing To Excel

Hello,I am struggling with a similar problem as this post (I think?). One of my attributes in the Workspace contains a 0 or 1 that is used as a Boolean. The value has been assigned the datatype ‘buffer’ in AttributeCreator and ‘string’ in the FeatureWriter, which outputs an Excel file. I am using a template, where the cell format is set to ‘General’.For some reason, the Excel file that is generated will give me inconsistent formatting of the attribute value: What is going on here??? As you can see, even though they all should be interpreted as strings, some of the values become numbers. The formula bar does not show anything different. I started using the Excel template in hopes of making the data format consistently, but even when I changed the cell format to ‘Text’ it still gave me issues when being read by Python. I would like to solve this issue before reverting to a Yes/No or True/False format. What could be causing this? Any insight is appreciated. -Thanks

856

26 days ago

matthewbContributor

asked in Data

Conditional Adjacent Feature Value Grouped by Attributes

I have a dataset that has customer data, vehicle data, planned driving distance (with a bunch of other scrubbed attributes). In this data, there are many days when a customer was not planned to have accumulated any distance but did use a machine. If the planned driving distance to date is missing, I want to copy the value for the previous planned_Driving_dist_to_date that has a value, but I want this sorted by date and grouped by customer and machine. The attached spreadsheet shows my dataset.

231

26 days ago

vxn43Supporter

asked in Authoring

Writing to spreadsheet question

Hello, All my data is in Excel spreadsheets. All the schemas are the same.I have two readers:The Updates Reader includes the 3 records that have been changed. These 3 records already exist in the Address Reader spreadsheet.The Address Reader is the original spreadsheet that includes these 3 records before they were updated. I would like these updates written to the Addresses Writer which creates a new excel spreadsheet with the 3 records updated but no new records added. In my workbench here, I run it, and the results are the 3 records are added to the 95,393 thus the new spreadsheet has 95,396 records in it. Having the 3 records added results in having 6 duplicate records whereas previously there were no duplicate records. I need the Addresses output to be 95,393 records with the 3 records I mention previously updated. I have tried changing all the parameters in the Writer with no success. The results are always the same, 95,396.I know I can use FeatureJoiner/FeatureMerger, but is the

161

26 days ago

mr_fmeEnthusiast

asked in Data

"Shadown" in final Mosaic

Hi,I'm using the Raster Mosaicker to create a mosaic with overlapping images. However, the final result generates 'shadows' as shown in the image below. What is the best configuration or additional transformer I can use to solve this problem?Thank you

394

26 days ago

meijerContributor

asked in Integration

Esri portal Feature Service Upsert

Hi all,I’m working with a Feature Service containing approximately 1,000,000 sensors stored in a spatiotemporal big data store. I need to update 10,000 of these sensors based on their unique string ID, like sensors-0x21222.Currently, I'm using the FeatureWriter for the 'Esri ArcGIS Portal Feature Service' with the 'Use Global IDs' option enabled and 'Upsert' set as the 'Feature Operation' in the Feature Type. However, 'Upsert' requires a global ID.This approach feels very constrained, as it requires importing all 1 million records, merging them, and finding the global ID for each update.Is there a way to update a Feature Service using a primary key or unique field (such as upserting with a where clause) rather than relying on global IDs? This current method doesn’t seem ETL-friendly, as it requires importing parts of the dataset just to make updates.Thanks in advance for any guidance! Edit:Maybe I don't understand it. But for every featureservice/layer/featuretype I need to add, to fi

362

27 days ago

gisgeekContributor

asked in Authoring

Scraping data from a map

Hi there I would like to scrape the data from this page. So want the lat/longs of the pins on the map and the background water outage data. I can't find an easy way to scrape the data and am just going around in circles trying to extract the data. https://www.ccc.govt.nz/services/water-and-drainage/water-supply/maintenance-and-repairs/water-status-map/#12

GEOTIFF Writer Interleaving Type option doesn't seem to work

When writing to Geotiff I would like Band interleaved by Pixel (BIP, interleaved RGBRGB) rather than Band Sequential (BSQ, per channel RRGGBB) interleaving but whichever option I use, the Geotiff always saves using Band Sequential interleaving.I have checked using Photoshop and also GDALinfo and both agree that INTERLEAVE=BAND rather than PIXEL. Is this a bug/can anyone else replicate this?

1133

27 days ago

jo_faucher82

asked in Transformers

Additionner le nombre de fois qu'une valeur se retrouve dans une colonne?

Bonjour,J’ai une table avec plusieurs colonnes (23) chaque colonne à la valeur 0, 1, 2 ou 3 dedans. J’aimerais savoir une façon de calculer le nombre de fois dans une ligne que l’on peut retrouver la valeur 1, 2 ou 3 et mettre ce résultat dans 3 colonnes distinctes (une pour le 1, le 2 et le 3) voici l’exemple du résultat :Merci pour votre aide!

352

27 days ago

nsmartParticipant

asked in Data

Reading CSV and Writing to MSSQL Database: tables not recognized by geometry_columns

Hello :)Here is what I am doing: I am working with FME-Flow and FME Workbench 2023.1.1. I have geodata in the form of .csv-files and am using a simple CSV-Reader ➡ MSSQL-Writer to create my datatable in my MSSQL-database (see attached image for FME-script). The datasets are saved to the ‘dbo’-schema and work without problem in GIS (QGIS in this case). This is done for a number of CSV-files. As an example I have shown the summary annotation for the dataset ‘ov_boende_aldre’.What’s the issue? When FME writes to the MSSQL database, the resulting datatable(s) is/are not recognized by the systems view ‘geometry_columns’ (se image below). Why not? When creating a dataset directly in MSSQL or in GIS (QGIS, for example), the dataset appears in said systems view. What can be the issue here? Any secret sauce to make FME create the dataset correctly that I am just missing?All help and hints are appreciated. Also, if you are aware that there is a similar post with a solution then do please direct

252

27 days ago

fmebeginnerContributor

asked in Authoring

Adding dynamic date string suffix using BulkAttributeRenamer

Hello, I’m trying to dynamically add a suffix to selected attributes using BulkAttributeRenamer. I want the suffix to be the day the script is run and expressed in YearMonthDay.Example: the attribute is “addresses_count_“ and using the BulkAttributeRenamer and running the script on the 24.10.2024 I want it to be “addresses_count_20241024”.I tried using UserParameters. The first parameter I made was a Text Type Parameter where before the script is run the User needs to input by hand the Date. It has a few flaws. For example, the user may enter the wrong date, the date is not entered automatically by the script and will not always be processed correctly by BulkAttributeRenamer.The second UserParameters I made and think it is the right way to do it is a Scripted Type Parameter. Below you can see what I made.I have not been able to get this to work using the BulkAttributeRenamer. Even when I select the string to be a UserParameter it doesn't seem to add and generate a correct date string.

636

27 days ago

1
...
5
6
7
8
9
10
11
...
1103

Page 8 / 1103

Badge winners

arunkumarkchas earned the badge FME Form Basic Training
malthernhas earned the badge Student (Grey)
sgsolingenhas earned the badge Teacher (Grey)
changeofmotionhas earned the badge Teacher (Grey)
User15923979821343989192has earned the badge Welcome Back

Show all badges

30,146: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.