Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,088 Posts
  • 26,096 Replies
7088 Posts
M
mbfoldmeres
asked in Data
How to extract point cloud information from a ZFS file?

Hey I have a dataset from a Z+F scanner in ZFS format. The thing is, the data is coming from an MLS system, not from a TLS system, which means that the point cloud is generated by the movement of the car, not because of the rotation of the scanner. This will result that, the whole cloud being exported to a single plain, as one data record. The original idea is, that if the points can be extracted, the points can be synchronized via the trajectory time stamp, but I was not able to extract the points properly.  Please advise, on how to figure this one out, to be able to create a proper MLS cloud. If you do not have the exact answer, but you might have some clue, that would be also helpful. Thank you for your help!Bálint

1040
evieatsafe
Safer
philippeb
Enthusiast
philippebEnthusiast
asked in Data
Directory Watch - Retrieve file name into an email

Hello!Is it possible to get the new file name created (or modified or deleted) by the directory watch and send it into an email via subscriptions?If not, how can I send the new file name detected?Thanks.

100
danminneyatsaf
Safer
M
manca_ent
asked in Data
Is there a transformer/function in FME that allows me to read attachments from an ARCGIS Online feature layer and append them to another ARCGIS Online feature layer?

Surveyors are collecting data on-site and taking photos as attachments unto an ARCGIS Feature Layer. Depending on the infrastructure category, I need to display these survey results across multiple ARCGIS Feature Layers. Is this possible without saving the attachments locally first?

1660
M
rudy_v
Contributor
rudy_vContributor
asked in Data
Database Connection - Config for Secondary - Readonly Database - SQL SERVER

We are using SQL Server 2014 deployed as 3 node cluster with 1 primary and 2 secondary. We need to connect to the READONLY secondary. To do that you the set the Application Intent=readonlyBut i cannot find the parameter setting in the database connection for SQL Server.

590
rudy_v
Contributor
A
aneta
asked in Data
Hi, I have an ifc file and there are attributes like volume, width, height etc . I can't see them in fme. I even tried to expand the format attributes. Does this mean that reading IFC files is limited to a certain number of attributes?

Hi,I have an ifc file and there are attributes like volume, width, height etc . I can't see them in fme. I even tried to expand the format attributes. Does this mean that reading IFC files is limited to a certain number of attributes? How can I turn on the visibility of these attributes? Is it possible? I've attached a screenshot. The attributes I want to process are in a red box. Regards,Aneta

520
magi
mohamdwassouf
mohamdwassouf
asked in Data
How do you design a simple architecture on Revit and import the IFC file to FME and then convert it to citygml format. Thank you so much.

How do you design a simple architecture on Revit and import the IFC file to FME and then convert it to citygml format. Thank you so much.

170
mohamdwassouf
philippe33000
philippe33000
asked in Data
AIXM 5.1 : Technical issue with AirportHeliport ( " responsibleOrganisation" and "annotation")

Hi everyone,I try to put the "responsibleOrganisation" and " annotation" in my AIXM 5 writer. My workbench seems to have an issue but i didn't find where is the problem.I tried with an older version of FME (2017) and everything is good. I put here the 2 versions of the workbench. ( 2017 and 2022). With the written files output. If someone could help. Something seems to ne wrong with the "geometryPropertySetter", with the "XMLTemplater", and probably with the writer AIXM5. 

200
philippe33000
T
tman
asked in Data
SQL Writer Column Length

Hello!  I am trying to write to an MS SQL DB and some of the feature classes have a primary key where the column name is longer than 30 characters.  On the writer feature types, I can set the default primary index colum to a length longer than 30 characters, but when I look under the user attributes, the column name gets truncated to 30 characters.  When I try to write the features to the DB, it fails because the field names are no the same.  Does anyone know if there is a work around for this, or how I can get a column name longer than 30 characters to be recognized under the features user attributes?  Thanks! Tristan

1330
M
M
momo
asked in Data
How do I perform fme_db_operation on GeoPackage using an UUID (no integer)

Hey guys, is it possible to perform an INSERT/UPDATE/DELETE operation (fme_db_operation) on GeoPackage using an UUID which isn't an integer?The UUID was created by UUIDGenerator. If I execute the following workspace, I'll get this error message:e.g.OGCGEOPACKAGE writer: Cannot perform Delete on feature type 'original' by matching attribute 'UUID' since value '{48fb8445-ca8d-4f74-94ed-b0ce6c89ffdc}' is not an integer. Skipping feature. Workspace:Writer-Settings (unfortunately in german language) Thank you very much!

510
M
M
michafranz
asked in Data
IfcOpeningElement does not cut/subtract windows in IfcWall.

I'm trying to import different IFC modells via IFC Reader and for some it happens that the walls do not contain the respective openings where the windows are (see Screenshots of BIM Viewer and FME Inspector. I tried different import settings, and thought especially "Subtract Opening Geometries" should solve the problem but it still didn't work. I'm having a hard time finding a solution as I'm not entirely sure how FME cuts out these openings.  Any suggestions what might casue the problem?

150
M
C
chris_disguise
asked in Data
I need to convert a collection of GEOTIFFs to a format that can be uploaded to Cesium Ion with the spatial reference system intact.

I've been trying to convert them to PNGs and TFWs but with everything I've tried so far, Cesium tells me "Missing or invalid spatial reference system".

390
caracadrian
Contributor
gisbradokla
Enthusiast
gisbradoklaEnthusiast
asked in Data
convert ascii format from TX RRC into usable data. (308 bytes per record, schema description with beginning, ending positions.

I have many files in this ascii format. The RRC has MAGNETIC TAPE USER GUIDE with field descriptions that contain beginning and ending positions. I have attempted to use the schema mapper with csv file that describes this but have yet to figure out how to make that work.please help,Files are located here. The file looks like this...The format description is like total bytes per record 308 bytes. MASTER FILE TAPE RECORD SEGMENT KEY NAME DESCRIPTION 01 DAROOT DA ROOT SEGMENT 02 DAPERMIT DA PERMIT MASTER SEGMENT 03 DAFIELD DA FIELD SEGMENT 04 DAFLDSPC DA FIELD SPECIFIC DATA SEGMENT 05 DAFLDBHL DA FIELD BOTTOM-HOLE LOCATION SEGMENT 06 DACANRES DA CANNED RESTRICTIONS 07 DACANFLD DA CANNED RESTRICT

750
M
daveapegg
Contributor
daveapeggContributor
asked in Data
How can I stop the Dynamic GDB Writer from writing the "_resolved" attribute after resolving the domains?

I am writing to a Dynamic GDB writer using an existing GDB with Domains as the Schema Source. I am resolving the domains otherwise just the values come across, but it is also creating a new attribute called "attribute_resolved" which is then being written into the feature class in the GDB. I have tried to use an attribute remover and an attribute manager to remove these attributes prior to writing, but they still get written. Strangely these attributes don't exist in the Attributes To Remove dropdown list in the Writer. Any help would be greatly appreciated.

70
G
jiro
Contributor
jiroContributor
asked in Data
Updating a Geopackage file issue

Hi,I need to update geospatial data in Geopackage format from a Google Sheet file that contains addresses to geocode that are updated regularly. The process of creating points via geocoding works very well. However, I need to create buffers around points based on an attribute of a field and use the existing Geopackage output file to add the update news. I also have to update the output file of the points in order to add the new entities to the Geopackage file by specifying in my output file the table to update.  Unfortunately, when I run my workspace I get the following error message:OGCGEOPACKAGE writer: Requested feature type 'zone_buffer_300m' does not exist. OGCGEOPACKAGE writer does not have the ability to create new feature types. Create the feature type on the dataset before writingOGCGEOPACKAGE writer: A fatal error has occurred. Check the logfile above for details.Attached is a screenshot of the output file configuration settings window and the entire FME workspace.Tha

760
jiro
Contributor
jhawks
Contributor
jhawksContributor
asked in Data
Missing DLL's in Server logs:

FME Server 2022.0.0.2 702022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that_func.dll' : 'The specified module could not be found'712022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that_func.dll' : 'The specified module could not be found'722022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that.dll' : 'The specified module could not be found'732022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that.dll' : 'The specified module could not be found'https://community.safe.com/s/article/Known-Issue-Instability-Running-Python-on-FME-2022-0-for-Windows-10-and-Windows-Server-2019-Version-1909-or-Older

190
jhawks
Contributor
juanmahere
Supporter
juanmahereSupporter
asked in Data
ArcGIS Online Feature Service 'XXX_layer' does not support writer mode

Hi all,I'm encountering an issue while reading from a PostgreSQL DB and trying to write into a AGOL Feature Service. If I run using the FME Desktop 2021.2, the process run perfectly, reading and writing the Feature Service. When uploading the Workspace into FME Server (FME Server 2021.2.3 Build 21812 - linux-x64), and running it, the message is this one: ""2022-7-15 14:15:44 | ArcGIS Online Feature Service Writer: Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator""Although telling me the correct of the Features were written. From AGOL, I've checked that is ENABLED the edition on features. Also, the FME Server has correctly Authorized. Is there something that I'm not having into account?Thanks,  

1350
juanmahere
Supporter
tb09114
Supporter
tb09114Supporter
asked in Data
Usability of DGN seed files

Earlier I asked about writing out DGN files with coordinate system.That's apparently not possible until now. But I would like to know how I can use seed files to get at least the symbology of a seed file into the DGNV8 writer. I referenced the seed file in the settings part of the DGNV8I reference a cell file in the settings as well I read my data in, define the level names in an AttributeManager based on the input data, use the PROJReprojector, to adjust the input data to the coordinate system of the seed file, and connect to a dynamic DGNV8 writer. In the DGNV8 writer I am missing the possibility to state that colour, style and weight will be used on the level, and not the individual object in the level. The level and level overrides section in the writer I cannot understand. My output dgn consists of multiple levels, yet the settings seem to point at one level only.Hence, I do not know how to configure the writer correctly.Leaving the level settings part undefined, but setting

1450
tb09114
Supporter
christelle
Contributor
christelleContributor
asked in Data
Problem when calculating volume with Reader Revit

Hello,For a job, i need to calculate the volume of a 3D object. The object has curve (its a piping)If I read the data with Revit Reader and calcul the volume, the volume is smaller than in Revit. (more than 1 cube meter)If I export the model in IFC the volume in quantity set in the same as in Revit, but if I I calculate the Volume, it's too smaller than in Revit but it's almost the same.I compared the export IFC and the the Revit file in Data Inspector. The number of facets is bigger in IFC than Revit.My question is : how i can increase the number of facet in the Reader Revit so that the definition of my object is more accurate?thank you for our help

460
andreaatsafe
Safer
D
dominik
asked in Data
Create IfcOpeningElement in ifcWall

I'm not very advanced in FME and ifc-Conversion. I would like to place an IfcOpeningElement in a IfcWall (and afterwards place a window or door in it). With the excercise "AutoCAD to IFC Conversion Example" I was able to create my walls and openings. But I'm not able connect the two elements. I guess I need to create an IfcRelVoidsElement. But how can I get the corresponding RelatingBuildingElement and RelatedOpeningElement? From the geometries I get the relationship. But how can I link these to correct EXPRESS-ID (eg #23)?  I will add a screenshot from my workbench and the (as txt-File) I get as result.  It would be great if someone can help me! Thank you very much in advanced!  Greetings from Switzerland  

500
morja
Contributor
arnovananrooij
Contributor
arnovananrooijContributor
asked in Data
How to get schema from FeatureReader when login username is schemaname

Hi,I'am trying to read a schema from an Oracle table through the FeatureReader. This works well for lets say TEMP.TABLE when the connection user is a different name than TEMP. When I connect using a user TEMP I don't get a schema. But after removing TEMP. the FeatureReader returns a schema. This if no problem when I know in advance which user is connecting, but in my case it's all dynamic. We use connection names and the user behind this connection can be the same as where the tables are stored.Is this a bug? Or does anyone have a solution? Thank you,Arno

120
kailinatsafe
Safer
S
siriosus
asked in Data
Can't read events from Azure EventHubs using AzureEventHubsConnector

Hello FME Community I'm getting following error when trying to read events from Azure EventHubs using AzureEventHubsConnector: Python Exception <TypeError>: Message data is not compatible with string type: 'generator' object has no attribute 'decode'All parameters were set correctly and events are actually passing through other clients.   Thank you in advance! 

440
JennaKAtSafe
Safer
M
mr_ene_
asked in Data
How do I set up connection for trainingdatabase

Hi I am trying to set up the trainingdatabase and are using the correct credentials that is specified in course. host: postgis.train.safe.com, port 5432, DB fmedata User fmedata PW fmedata. When test i got no answer from server. Tested in cmd and it seems to be down?..

40
kailinatsafe
Safer
joeri
Contributor
joeriContributor
asked in Data
Remove layer from PDF (flatten)

I'm using a geospatial pdf writer to export a map that was styled with a PDFPageFormatter. The PDF opens correctly in Adobe reader, but not in a webbrowser (Chrome/Firefox). After removing the layer by flattening the pdf (using an online tool or Ghostscript) opening the PDF in a webbrowser is possible. Is there a possibility in FME to flatten the PDF, the PDF-writer always demands a layer name... So writing without creating a layer is impossible.

2060
joeri
Contributor
galigis
Enthusiast
galigisEnthusiast
asked in Data
Read 'Element Information' from a DGN V8 file

Hi Community, How can I read / expose the element information from a DGN file? Need to be able to read General > Description as the following screenshot shows:I have already played around with the Reader DGN parameters (e.g. read tag attributes, Read XAttributes, etc) with no success.  Any help would be much appreciated. Thank

1750
galigis
Enthusiast
tb09114
Supporter
tb09114Supporter
asked in Data
Is there a way to access S57 data that are password restricted?

I have data in S57 format coming from the UK Hydrographic Office (UKHO) which I need to read into FME.When I try to read them in I get the following error message: DE4OS09G.000 isn't an S-57 data file, or catalog.Failed to obtain any schemas from reader 'S57' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. I tried to read them with FME 2022.0.0.2 (20220518 - Build 22343 - WIN64), and as I point out in the question, the access to the files is restricted. There is at least an UPN (User Permit Number) needed to read the data. I do have one, but no possibility in FME to make use of it.

240
kailinatsafe
Safer

Badge Winners

  • Welcome Back
    nataliarojashas earned the badge Welcome Back
  • Integrate Spatial Data
    dezuviriamhas earned the badge Integrate Spatial Data
  • FME Form Basic Training
    johnrochehas earned the badge FME Form Basic Training
  • FME Form Advanced Training
    sahan969has earned the badge FME Form Advanced Training
  • Student (Bronze)
    marionmahothas earned the badge Student (Bronze)
Show all badges

Community Stats

31,800
Posts
120,801
Replies
39,417
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.