Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,015 Posts
  • 25,845 Replies
7015 Posts
loicgueninrande
Contributor
loicgueninrandeContributor
asked in Data
Geoparquet Reader on FME Form 2024

Hi @Safe !I have a probleme with Geoparquet reader on FME Form 2024. It does’t work with the file in attachment but work fine with Apache parquet on FME Form 2023. The error is :Thanks for your help.Loïc

765
AliAtSafe
Safer
P
proudgis
asked in Data
How to set extents on DWG ouput file

I am writing AutoCAD DWG with changing areas/extents. My template file defines the styling. When opening the file in CAD it zooms to a blank area (possibly from the extents of the template file) and I need to zoom to extents to find my current area. Is it possible to either remove any extent information from the template file, or force the output DWG file to zoom in on the current area extents?

1376
scottchase
Participant
piercephi
Contributor
piercephiContributor
asked in Data
Cloned list between two sets of values based on a rank

I need to generate a list between two numbers and repeat a value the number of times between the two numbers. The values need to generate the number of rows between the higher ranked value and the lower ranked value. Below is the data I have now, and the second screenshot is what I need generated. Thank you for the help.What I have now:What I need: 

282
piercephi
Contributor
G
gisadamgis
asked in Data
Issues connecting with Portal !!!

Hello,I'm having issues trying to connect to the my Portal that is using OKTA - Auth2 to login.I've seen a fee threads on here regarding this issue but does not really explain clearly oon what to do.  I get this error "OAuth2 Approval Please copy this code, switch to your application and paste it there: " I followed the steps to register FME in Portal. Filled in all the correct info in the Manage Web Services. I put in my crednitals and get that error. I don't even know if it;s an error. I just dont know what to do at this point ? OAuth2 Approval Please copy this code, switch to your application and paste it there: "  I've seen a couple threads, but didn't really give an answer just said to submit a ticket.https://knowledge.safe.com/questions/109164/failing-to-connect-to-esri-arcgis-portal.html  https://knowledge.safe.com/questions/88927/how-do-i-reliably-connect-fme-server-201819-to-arc.html Can someone please help me figure this out . Thank you

785
salmayarista
Participant
g.bizournet
Contributor
g.bizournetContributor
asked in Data
Oracle Update sysdate problems

Hello,  Using a SQl executersyntax: update <table name>  set date_start= to_char(sysdate -1,'dd/mm/yyyy')        where  DATE_START is nullcommitNo updates of the tables.Does FME have a problem with using Oracle “to_char(sysdate -1,'dd/mm/yyyy')”?Because the syntax works under ORACLE SQLPLUS  

1078
g.bizournet
Contributor
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Data
Create Hyperlinks in Excel

I am struggling to save text as a hyperlink in Excel. I tried using this formula:=HYPERLINK("http://www.1spatial.com/fme","http://www.1spatial.com/fme")However, the outcome in Excel didn’t work as expected.  Does anyone have any idea why it behaves this way?

511
david_r
Celebrity
mariaka
Contributor
mariakaContributor
asked in Data
3D object appears transparent

IssueI have several 3D objects (coming from IFC) with variable appearance styles. In one case the style seems transparent. Both in FME inspector and in the final writer (Cesium3DTiles) these objects are kind of transparent.(see feature informations in annex)the dark-red “wall” seems transparant by contrast with the two parts ontopWhat I did so farChanged/Reset appearance (AppearanceSetter) → no effect checked on Geometry (GeometryValidator, VertexNormalGenerator, GeometryRefiner, etc) → no effectQuestionsHow can I make the transparent objects opaque? What’s the difference to the other objects?

553
mariaka
Contributor
sworkman
Contributor
sworkmanContributor
asked in Data
Split list by keyword to individual lists.Or something??

Hello, I have a pdf report that I need to parse out. I can read it and create a line by line list. It has a line with employee code/name, then subsequent lines with codes and their values associated to the employee. Here is a sample of the report and then what it looks like when it is read in. I can get it split nicely into rows/columns/attributes no problem. My issue is that I dont know how to break it up in each employees portion and add the employee number to each row.There would be a few hundred employees. So in the end I want to be able to spit out a table that has the columns:Employee num, Code, Description, units, extensions,etc I am very new to FME and just struggling to get it figured out. I dont know if I should be using some kind of loop, python code, aggreator etc. Any help would be greatly appreciated!  

542
sworkman
Contributor
mmccart
Supporter
mmccartSupporter
asked in Data
How to Set Update Key Column on ArcGIS Online Writer 2017.1

I need to update an ArcGIS Online feature service using something other than 'OBJECTID' field. In previous versions, I was able to set the "Update Key Field" in the 'Properties' dialog box of the AGOL Writer. In 2017.1 that option is gone. I can't find any documentation or examples on how to set the Update Key Field to something else.Any suggestions?

1018
izabreton
Contributor
adnanyazdani
Contributor
adnanyazdaniContributor
asked in Data
Import data from Excel spreadsheet using file path provided in excel

HiI need guidance / SupportI have an excel where FiletypeName: .MDBPath of the MDB is mentionedWorkspace should read the excel and go to tha path mentioned in the excel and read the mdb for each and it should individual for each   Workspace should go to that path and read the MDB file in which Different FC are mentioned and then write it back with same Name of MDB and Fc in GDB formatKindly Guide me how can i proceedI have attached sample data with excel and MDB

1555
evieatsafe
Safer
nordpil
Supporter
nordpilSupporter
asked in Data
Reading/Writing SDE Archived featureclasses

I have MSSQL ESRI Entrerprise Geodatabases that are non-versioned but have archiving enabled. As far as I have figured out, there are no ESRI tools that easily copy data with the full archive of the feature class.If it was versioned I could use the ESRI tools for replication…What is the current best methods for an operation like this?

582
nordpil
Supporter
abnan0001
Supporter
abnan0001Supporter
asked in Data
extracting information from different folders from KML

Hi AllI would like to extract the information of each folder and sub folder in different field with the folder and sub folder names as snapshot attached.I have 4 Main folder and  sub folders for each.  In a new column lets called : folderdetails - Active camera traps , Removed camera traps etc this has to be taken.Similarly for sub folders alsoAny guidanxce and support , I have tried doing but im not getting the way i should i needed  

946
danilo_fme
Evangelist
L
leuciriccardo
asked in Data
IMPORT KML AND/OR EDIT GOOGLE MY MAPS.

I tried with google fusion Table, but the service is down. if anyone has alternative to mymaps for creating an editable map on field, i am all ears

844
danilo_fme
Evangelist
stfcjoe
Participant
stfcjoeParticipant
asked in Data
ArcGIS Online Feature Service Writer: Error 405

Hi there, I keep getting this error message: ArcGIS Online Feature Service Writer: Encountered an unexpected error. The error code from the server was '405' and the message was: 'This SqlTransaction has completed; it is no longer usable.'. Details: 'Unable to apply edits. Please check your parameters.'  Any ideas? It’s attempting a truncate. I have purged temporary files and tried to replace all the connections and make a copy of the workbench but still no dice. Thanks,Joe

1854
crystalatsafe
Safer
tsol
Participant
tsolParticipant
asked in Data
Writing to existing MS Access database fails with Provider Error (-2146825023)

I have an exsiting MS Access database. I would like to insert some updated rows to the existing table named tbl_STATIONS, so that the existing rows will be updated. However, it fails with the following error.Microsoft Access Writer: Failed to write attribute `Id_station' of feature type `tbl_STATIONS'. Provider Error `(-2146825023) Impossible de trouver l'objet dans la collection correspondant au nom ou à la référence ordinale demandé.'What is the issue here?

191
AliAtSafe
Safer
matt.albritton
Participant
matt.albrittonParticipant
asked in Data
Repair Geometry with ArcGIS Repair Geometry tool

How can I use the Python caller transformer to call Arcpy and run the ArcGIS Repair Geometry tool? I have polygons from a file geodatabase that I'm importing into our Postgres SDE. After loading them, many of the records won't display due to geometry violations. I tried using the FME Geometry Validator transformer in my workspace, but it didn't seem to resolve the issue. Alternatively, is there a way to configure the Geometry Validator (or combine it with other transformers) to repair the data?

853
danilo_fme
Evangelist
andyliu
Participant
andyliuParticipant
asked in Data
How to use FME to read the Extension Dictionary of DWG data objects, that is, the associated information of the objects?

The Extension Dictionary information is written using C#, as shown in the picture below: 

121
hkingsbury
Celebrity
akesoderqvist
Contributor
akesoderqvistContributor
asked in Data
DGN V8 Master units extraction

Hi, im doing a workspace to check DGN files and i would like to see the linear units as shown bellow: Is there any attribute to expose for this or do i need a python script for it? I have checked the DGN readers help page for this but cant realy find anything. Very thankful for any answer. 

282
AliAtSafe
Safer
ingalla
Contributor
ingallaContributor
asked in Data
Feature Reader Where Clause

HelloI have set up a feature reader, reading a geopackage and have also set up a user parameter requesting the GSS code from the user to find.When i add “gsscode” = $(LOCALAUTHORITY) nothing is exited via the reader, however, if i remove the where clause from the reader and add a tester with gsscode = $(LOCALAUTHORITY) everything works as expected.Please see images below, but any ideas what is wrong.  I dont mind having a tester, but would just like to remove it and use the WHERE Clause..Regards Andy Feature Reader Parameter  Tester 

462
ingalla
Contributor
muhammadsambe0
Contributor
muhammadsambe0Contributor
asked in Data
Difficultés pour télécharger des données depuis la plateforme data.gouv et des données IGN (BD Topo, BD Carto)

Bonsoir,Je rencontre des difficultés pour télécharger des données depuis la plateforme data.gouv et des données IGN (BD Topo, BD Carto) via URL en utilisant FME.Je ne sais pas si cela provient des liens url que j’utilise, des Transformers employés, ou des paramétrages de mon workflow FME.Mon objectifJe souhaite récupérer des données exploitables selon les thématiques suivantes : environnement, économie, agriculture, etc.En pj, mes traitements en détails avec des captures. Merci d’avance de votre précieuse aide

230
muhammadsambe0
Contributor
magda_cz
Contributor
magda_czContributor
asked in Data
Unexpected end of file reading

Hi, While trying to read a shapefile, I encountered the following error. Has anyone come across this issue? It stopped reading all other files: Shapefile reader: Unexpected end of file reading 'filepath\filename.dbf'. Please report this error to Safe SoftwareGeometryFilter_InputPassThrough (TeeFactory): Failed to get block of 235 features starting at index 0Failed to get block of 235 features starting at index 0 When I tried using the FME Data Inspector, I received the following errors: Shapefile reader: Unexpected end of file reading 'filepath\filename.dbf''. Please report this error to Safe SoftwareFFS writer: Failed to get block of 235 features starting at index 0Failed to write feature data to `C:\Users\--\AppData\Local\Temp\FFS_1736990572395_5844_DATA.ffs'Failed to specify the feature index as constraints on the reader Thank you for any suggestions on how this can be resolved. The file is recognized in ArcPro. Thanks,Magda

593
s.jager
Influencer
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Data
Expand HTTP Settings when reading file from web

When reading a file from the web the only options available to configure the client is the Authentication section. In some cases it is needed to tweak some of the client settings in order for requests to properly get though. Sometimes it would be nice to add custom headers or change the SSL settings for example.Of course the workaround is to just stick a HTTPCaller followed by a feature reader, however, this also means that you need to deal with temp files etc etc which just adds complexity to the workspace

202
virtualcitymatt
Celebrity
yahyanar
Contributor
yahyanarContributor
asked in Data
Join multipe excel files with multiple sheets

I have 3 Excel files and each one has multiple sheets [T1(sheet1, sheet2..,etc), T2 (sheet1, Sheet2,..etc), T3(sheet1, sheet2,...etc). The names of the sheets in all files are identical and the name of the fields in each sheet are identical too but fill with different data. I need to join or merge each sheet from one Excel file with the corresponding one from the others based on a common field (ID) and have one excel file. I did different attempts but I did not get the right results. Could you help please.

221
liamfez
Influencer
mariaka
Contributor
mariakaContributor
asked in Data
Cesium 3D Tiles miss some features when converting from IFC

Hi all,I’m facing some troubles converting IFC data to Cesium 3D Tiles.Background:I have several IFC files containing mostly 3D objects concerning civil engineering source coordinate system: EPS:2056 different, user-defined PropertySets different IFC versionsGoal:Cesium 3D Tiles with all attributes (PropertySets)What I did so far (transformers in FME):Adding a dynamic reader with autodetecting IFC version Extracting PropertySets from Geometry Doing some cleaning on Geometry, i.e. removing extra Bounding Boxes and adding Vertex Normals Scanning the schema Writing dynamically to Cesium3DTiles FME Version: 2024.2.1.0 (Build 24801)Problems:some features are missingI cannot see why some features/objects are missing. They obiously run through all transformers until the writer. There are no errors, only 2 warnings saying:NOT changing coordinate system of reader identified by keyword `IFC_1' from `EPSG:2056' to `IFC_COORDSYS_0' -- mapping file setting of `EPSG:2056' overrides coordinate system

10010
virtualcitymatt
Celebrity
zsturm61
zsturm61
asked in Data
FME Server Job running on static data

Hi having an issue where my FME data update job is running fine from Desktop when you click run.  But when I published the job to FME server and set up an automation to run nightly, it seems to be pulling in old data when it runs. The job reads an excel spreadsheet in a folder and plots it and inputs the output data into our SDE.  It seems like when I publish to FME server the excel spreadsheet is not being picked up live from its file location.  

111
ctredinnick
Supporter

Badge Winners

  • Student (Bronze)
    mzuerhas earned the badge Student (Bronze)
  • Student (Grey)
    mzuerhas earned the badge Student (Grey)
  • Expert (Grey)
    mzuerhas earned the badge Expert (Grey)
  • Teacher (Bronze)
    mzuerhas earned the badge Teacher (Bronze)
  • Teacher (Grey)
    mzuerhas earned the badge Teacher (Grey)
Show all badges

Community Stats

31,378
Posts
119,008
Replies
39,008
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.