Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,705 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6705 Posts

Recently active

Most replies Most views Newest first

ostojaContributor

"Error running translation" when writting data to ESRI ArcSDE table

I have a very basic workbench, which reads data from FFS files and should write around 15000 lines in the ESRI ArcSDE Table (SQL Server 2014). Unfortunately, when the workbench is ready to write the data in the table, I receive "Error running translation" with two BADNEWS issues in log which appear only in Debug mode:....ArcSDE release: '10.0'. Underlying database: 'SQL Server'A default z-value of '0' will be used for all 3D features where z-values are not providedGeodatabase Writer: Not simplifying geometries being written to the GeodatabaseError running translation......Kindly find complete log here The writer which I use is "Esri Geodatabase (ArcSDE Geodb)". The same behavior I have with writer "Esri Geodatabase (Personal Geodb)" but if I change the writer to pure Microsoft Access, I am able to write in the data. In the Win Event Viewer I can find two error messages each time I execute the test (sorry that it is in German)I am u

r_hueskenContributor

Cannot read a TIN from a geopackage

Hi,I have a problem with adding a reader for a geopackage that contains a TIN. Adding the reader fails with the message: "No geometry mapping entry found for 'wkb_point' in metafile 'C:\\Program Files\\FME\\2020.1.0.1\\metafile\\OGCGEOPACKAGE.fmf'" Data is somewhat strange, since the layer identifiers are long (way over 30 positions) and contain spaces and minus signs. In QGIS, the data is displayed correctly though... Any idea what might be causing this error? The data is proprietary, so I can not share. I'm using FME 2020.1.0.1.

How to GeoServer to IFC?

Hey thereI don't know if this is the right place to ask but here we go anyways.I am trying to get data from a geoserver and transform 2D Data into 3D Data as an IFC. I am absolutely new to FME and I am struggeling to achieve anything. I tried that short example with AutoCAD to IFC Conversion: https://community.safe.com/s/article/autocad-to-ifc-conversion-example I Mean, it works fine, but I dont know what it does exactly. I somehow want to do the same, but instead of a AutoCAD building I want to transform some objects from a geoserver (electricity lines or other objects that are in 2D) into an IFC. Can someone give me some tips? Greetings,Philipp

Em dash - En dash UTF8 and all that Jazz

Hi Community,First post :)I have an IMAP publisher which downloads GML attachments. The files containing folder name is based on the email subject i believe. This seems to work perfectly when this file path is being processed by the Workspace subscriber. However, when the email subject contains an em/en dash character (i'm guessing anything not UTF8) the folder is then saved with the special replacement character in its name as shown.Once the workspace runs, it tries to use a JSONFeature to read the Topic message but the filepath is incorrect. FME log shows something like the following;XML Parser error: 'unable to open primary document entity '<FILEPATH>\\DBYD\\Incoming\\<FILENAME>_2??12_<FOLDERNAME>\\<FILENAME>_LLGDA94.GML'' Anyone any recommendations on how to deal with this please? Many thanksK

Is there a way of using the generated list of selected attributes 'values' created under the 'attribute accumulation' option of the PointOnAreaOverlayer Transformer to identify if a polygon feature contains the correct number of point features?

I have two inputs, a polygon shape file and a point shape file. The polygon shape file contains two area polygons, A and B. Each has a single, name attribute - A and B respectively. The point file contains 30 points and they also have a single name attribute, with attribute values ranging from A to E. Some of these points fall inside the polygons and others do not.As a rule, polygon A must only contain two A points and one E point while polygon B must only contain two B points and one E point. I input both shapefiles into PointOnAreaOverlayer transformer which filters out all points falling outside of the polygons. Within this transformer, I generate an attribute accumulation list on the Area outputs, with the selected attribute set to 'name'. Using listElementCounter, I can see if the correct number of points fall in each polygon - in this case 3. Using ListConcatenator, I can create an attribute listing the names of the points that fall in to the polygon, eg- A, A, E.I can

How to combine informations from the IfcPropertySet and PropertySetDefinition sections with the correct IFC object?

I try to import IFC file. I have a problem with combine informations from the IfcPropertySet and PropertySetDefinition sections. IfcPropertySet includes only: globalId, ifc_unique_Id and ifc_property_set_name. When I extructed elements from PropertySetDefinition section I see: ifc_property_set_name, ifc_properties.data_type, ifc_properties.name, ifc_properties.property_type.I don't see values for the name. What could be the reason for this?There is no id attribute. How do I connect these attributes with the right objects?

juanmahereSupporter

SHP and TAB have large differences on file size for same features. Why?

Hi,I may be missing some information regarding the TAB format, but I find quite inexplicable this behavior on file sizes: After creating a couple of layers, and sent to different formats (SHP and TAB) I appreciated that some of the brand new layers have large differences on sizes when comparing with same layers from a past delivery.Here are the figures from the 20th and 21st version of same layer: So, the new layer has decreased in vertexes, that's not peculiar, the strange thing is that with around 1k less vertexes SHP files decreased around 70MBs (0.001%) while TAB files decreased 141.000 MBs (55%). Is there any explanation for this? Thanks for your help!Juanma,

tomfContributor

Using functions such as @round() inside the XMLTemplater drops data

This is probably a simple question, but I'm having difficulty rounding values within the xml editor of the XMLTemplator.With the root template set to:<feature> <number>{fme:get-attribute("NUMBER")}</number></feature>The NUMBER value is written in the output. But when I use:<feature> <number>@round({fme:get-attribute("NUMBER")},3)</number></feature>or even:<feature> <number>@Evaluate(@round({fme:get-attribute("NUMBER")},3))</number></feature>the xml returned contains an empty string:<?xml version="1.0" encoding="UTF-8"?><feature> <number/></feature>I could round with an AttributeRounder prior to the XMLTemplater, but although that rounds the values in Visual Preview, the xml output can and does contain the floating point representation errors.I'm guessing this might be a syntax thing but I've had no joy yet implementing this in the editor.(FME 2020.1 b20620)

How do I translate "groups" into 3D tiles?

Hi. I am trying to take a 3D model that is build with several grouped geometries into components. Source format is flexible, but say I have an OBJ file with "g" lines in it that define groupings of parts of my model. I can't seem to see these groupings in FME or export them into 3D tiles - I get one single group for the entire output model.

checcosisaniContributor

Hi guys i found alot of question about CSS selectorbut no answer to my case so I tried to post my question How can select the blue info <span>ISTITUZIONE TEMPORANEA DEL DIVIETO DI SOSTA PERMANENTE CON RIMOZIONE COATTA DEI VEICOLI IN UN TRATTO DI VIA DONATO BRAMANTE.</span> which CSS I have to use ? Sorry I'm new but the help need more more more examples from my point of view thx for support Francesco

annette2Contributor

Writing an Excel formula where Use attribute names as column positions is set to yes not working

Hi,I have a complex Excel report that we have worked on for half a year on and off as part of an ArcGIS Survey123 project. The users have requested a formula in the Excel. I am using attribute names as column positions and have not been able to get it working.I have tested it in an apart workspace:This works: This does not work: I get the error which I would expect: 2019-10-11 16:24:04| 2.5| 0.0|ERROR |Excel Writer: Column name 'Q.formula' for sheet 'Sheet1' could not be used as a column position. It either contains non-alphabetic characters or is beyond the maximum column of XFD for XLSX or IV for XLS If Q.formula is not present in the output feature class than the formula does not write either. Is there a way to write a formula to an Excel sheet using the Use attribute Names As Column Positions parameter = Yes?

shivsParticipant

When i try to copy a table from a sde database to another sde database i get an error

When i try to copy a table from a sde database to another sde database i get the following warning."Could not find the features in the table 'tablename'. One possible reason is that a WHERE clause was specified that references a column/field that does not exist in the table. The error number from ArcObjects is: '-2147216086'. The error message from ArcObjects is: {Attribute column not found [tablename][STATE_ID = 797]" Also i get info "2021-01-11 17:05:12| 0.6| 0.0|INFORM|MULTI_READER(MULTI_READER): Will fail with first member reader failure" Can someone tell what am i doing wrong here ?

tsaryniukContributor

PostgreSQL 12 reading error

Hi all,There is a issue connecting to Postgresql 12.Error executing SQL command ('SELECT c.relhasoids AS oids FROM pg_class c INNER JOIN pg_namespace n ON n.oid = c.relnamespace WHERE ...... 'ERROR: column c.relhasoids does not existAccording to PostgreSQL 12 documentation, the "relhasoids" column has been removed from release 12.The error appears on both readers(PostgreSQL\PostGIS) and on different versions of FME Desktop: 18.1; 19.1; 20_beta.At the same time, the SQLCreator transformer reads the database without any problems.Has anyone else tested how FME works with new PostgreSQL 12?

Remove outliers of point clouds to extract the roof height

I have clipped point clouds of buildings and I would like to calculate the maximum height from these point clouds, but without chimneys and other small features. Is it possible to retrieve more detailed point cloud statistics which can be used for this? I am not looking for the median of average values of the point clouds, but really the maximum z-values of the roof constructions.

Esri Geodatabase (ArcSDE Geodb) writer is not updating features despite log indicating successful translation

My workspace compares data from an Oracle database and a versioned SQL Server backed Esri Geodatabase. The Oracle database contains mostly CAD and MapInfo data. It's the source of truth for the data. The SQL Server database is the destination where changes to the source should get written. I am using a change detector to determine if there are any differences between the features. The process generally works ok. The change detector populates the fme_db_operation attribute appropriately, and I'm using that to set the Feature Operation. My problem is that the process doesn't seem to update the features. The log indicates that it wrote the features and that the translation was successful. However, when I try to view the data in ArcGIS Pro, I'm not seeing the changes. If the process was successful, if I ran it again, I should see zero features that need to be updated. However, I get the same number of features that need to be updated over and over again. What could be ca

lifalin2016Contributor

Creating DGN v8 files with embedded attributes ?

Hi.Am I correct in assuming, that the DGNV8 writer cannot output neither tags nor XAttributes ?I found this tutorial on writing tags, but it doesn't seem to work: https://community.safe.com/s/article/writing-microstation-dgn-tags-with-fmeI then found this page, that says that both tags and XAttributes can be read, but not written: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/igds/DGNV8_reader.htmCan or cannot ?

Oracle connection issue: 'DEC-MCS' is not recognized as a valid encoding name.

HiMy setup:Mac OS Big SurFME(R) 2020.2.1.0 (20201130 - Build 20806 - macosx)Oracle Client installed (Version 19.8.0.0.0) Connection is set up correctly (for example giving wrong username I get error: Error connecting to Oracle database: message was `ORA-01017: invalid username/password) And when giving correct credentials I get error:ORACLE_AUTONOMOUS_NONSPATIAL reader: 'DEC-MCS' is not recognized as a valid encoding name. Any ideas what to try?

Unexpected Input during conversion from IFC to CityGML

Good morning, i have to use the FME software for my master thesis work. I'm trying to convert an IFC file to CityGML to put it next in QGis. I'm using just the readers i need to use for my purpose (Ifcdoor, Ifcwindow, ecc..) but during the translation the Unexpected Input says i have three types of features which cannot be converted, and that stops the whole conversion. Do you have any idea on how and where to connect those features? Because i don't really need those features, but it seems like there is no way of let the software to not consider them.

Difference between DatabaseUpdater and Feature Operation in Writer

I'm wondering what the difference is between the DatabaseUpdater transformer and setting the Feature Operation to Update in a database writer.I know there is a lot of overlap is some of the transformers in FME so i'm wondering if one is better or if they'll do the same thing.

Dropbox issue when retrieving data

Hello! I am having some issues when working with Dropbox both as data input and output. In the case of data input, there is one error that happens sometimes: a retrieval error. At least two different description of this error appears in the log>1. Retrieval error: Unable to create resource with duplicate name on web service2. Retrieval error: "web-service" reporting server-side error. This service may experience issues. (upstream connect error or disconect/reset before headers. reseat reason: local resetI am enclosing printscreens for both cases. Do you have any idea what's the cause(s) and how to overcome this?Thank you very much, Jorge

Is there a reason that the Autocad Writer will corrupting a dwg?

I have a workspace (attached to question) that writes leaders to a dwg template. As far as I can tell the template has no errors, but the resulting dwg has 2 errors and must be recovered to be opened. Has any one else encountered a problem like this? I have attached the workspace with the behavior described.

Unable to see FME generated cad file with the attributes in AutoCAD / Revit

I am trying to convert the ESRI format data(feature class) to cad using FME(I have used Extended Entity Data option). When I open the cad output in FME inspector I can see the attributes but when I try to open in AutoCAD or Revit I cannot see attributes attached to the features. Just wanted to know how can I get to see attributes in cad file in AutoCAD

aaronContributor

How read Excel data with dynamic schema (sheet name and attributes)?

I am reading an Excel file online where the sheet name and attribute names sometimes change. I therefore need to read the sheet and attribute names dynamically. I can get the schema but I haven't figured out how to read in the data using a dynamic schema. ("Scan Schema in Dynamic Workflow" doesn't appear to work for the Excel Reader.) I figured out how to use a FeatureReader to get the sheet name dynamically using fme_feature_type_name and then pass it to a second Feature Reader but I haven't figured out how to get the attribute names dynamically and then pass them along to the second FeatureReader so I can read in the data. Or is there another way?

Does writing to a MapInfo Extended TAB format take longer than to a MapInfo TAB ?

Does writing to a MapInfo Extended TAB format take longer than to a MapInfo TAB ? Just wanted to check with the community if this is a known/expected behaviour with writing data to MapInfo Extended TAB and also if there are workarounds to quicken the writing process.Although I have experienced FME 2017 take considerably longer time to write a MapInfo Extended TAB for polygon data that is about 1.2 million in count, I failed to take note of the actual time it took, from the log. I do have a stat for a much smaller dataset, that of 1500 polygons and it took about 14 minutes to write to a MapInfo Extended TAB

oscardInfluencer

File Copy - Copy empty Folders

Good evening.I need to copy all the content from a folder to another one. That means files and subfolders.I have been able to copy any file or subfolder with files, but if the subfolder is empty, it is not copied. I've been playing around with the filecopy_dest_dataset attribute, but no luck. I bet is something obvious, but I'm stuck. I'm using FME 2019.0.2 (64-bits)Thanks for any help provided!

1
...
49
50
51
52
53
54
55
...
269

Page 52 / 269

Badge winners

will.jones4has earned the badge FME Form Advanced Training
anshshubham246has earned the badge FME Flow Authoring Training
farfarhas earned the badge FME Form Advanced Training
joschhas earned the badge Student (Grey)
hkingsburyhas earned the badge FME Certified Trainer

Show all badges

29,739: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK