Using readers and writers to extract and load data.
Recently active
Before describing my issue, I already looked into the list of posts underneath:KB-article: Working with soap serviceQuestion: HTTPCaller SOAP issuesQuestion: Help with SOAPQuestion: Connecting to SOAPQuestion: FME desktop SOAP service issue problemBecause I first didn't succeed, I also installed SoapUI, as advised by @daveatsafe. And within SoapUI everything works fine. When I go to FME and use the HTTPCaller, I get an "HTTP/1.1 404 Not found"In the header I already added the SOAPAction (both with and within double quotes) and also copied all the other header elements and values in the header request. But still no difference. I also tried WireShark to look into the POST-requests, but since they're all encoded, I do not seem to be able to find any differences (and I can't succeed in decoding them, which seems to be possible). What I did notice in SoapUI is a different URL the POST-request seems to be send to, but when questioning that at my client, they tell me to
Hello,I am splitting 49 Polygons from one shapefile to 49 separate shapefiles (see inputFile and fmw attached).In the logfile I get a :Shapefile Writer: Maximum number of open output files reached, caching additional features until end of translationThe translation is successful and neither a warning or an error is outputted (see test-fmw-log.txt attached)All shapefile concerned by the caching are corrupt and I get a:Worker 2876 > Shapefile Reader: File size and filesize record in header mismatch. File claims size of '108' bytes but is '112' on disk. Reading as many records as possible, but file may be corruptI am working with FME(R) 2019.2.0.0 (20191105 - Build 19801 - WIN64)I think, these kind of translations never had problem...Thanks for your support.Florian
What I want to do is to write a DWG, define the color of the lines ByLayer (autocad_color = 256) and set the Layer Color according to the feature. As the layer names are dynamically formed, I can not work with a template.When reading the forums this seems not to be possible. But when reading the documentation, it looks like it is, as the "Used by Reader or Writer" column says Both.https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/acad/Feature_Representation.htmSo just to be sure, is it possible to get this to work? I could create a template on the fly and use that one if needed. Maybe a template in DXFR12, as that format is open?
Hi Guys, is it possible to acces a view in an Oracle Spatial database by the Oracel Spatial Object reader? When I try to connect, the table list doesn't show any existing view. In case the reader doesn't support reading views, is there any workaround to get my view as a feature type into FME Workbench? Thanks for helping,Wolfgang
Hello everybody, We are looking for a solution to update a spatial index in a Esri SDE database after the Geodatabase_SDE writer has finished writing the data. We are going the work with FME Desktop 2020. The only solution we could find is making an python script and use this in the "Shutdown python script" event. Does anybody know an easier solution?Greetings from the Netherlands
Hello, I'm searching for a way to obtain the external shape of a laz file and turn it into a line or polygon for and shp output.I've found something but it force me to "convert" in fme the point cloud entity to a multiple point entity. The issue with that method is that is that take a long time to process and that is not adapted to my data covers entire cities and has billions of points.Do you have any Idea on how can I proceed ?Here an exemple of the kind of data i have :
Hi, I have X,Y,Z,R,G,B txt file that I want to convert it to RGB coloured point cloud. The Point cloud creates fine, however without RGB colour assigned to points. How to assign RGB values to point cloud based on attributes? Any help much appreciated.Thanks, M
Hi,i'm trying to read features from a GDB and to import them into another GDB. The two GDB are basically the same thing just that in the start GDB some features are defined as "Double" while in target GDB they are defined as "Float".When i inspect the data from the reader in Data inspector i can see that some features look f.e. like 2603368.3700000001 instead of 2603368.37 (they all have maximum 2 decimals) and when I write them in the target GDB the decimals are completly gone. I tried to round them with "AttributeRounder" before write them and to change the "User Attribute Type" in the writer but it didnt help. Can anyone see what I am doing wrong?Thank you very much
I'm trying to connect to a local instance of MySQL 8.0 using FME Desktop 2018. When I test the database connection I get the following error:Opening MYSQL_DB reader for dataset 'test1'Error connecting to MYSQL database('127.0.0.1','test1'): 'Can't initialize character set unknown (path: compiled_in)'I can successfully: 1. Connect to a remote MySQL database in FME Desktop.2. Connect to my local test1 table in QGIS (using the same credentials).3. Connect to my local test1 table using MySQL Workbench.Googling seems to suggest the error is related to the database or table collation, but I've confirmed that the collation settings are the same for my local database and remote database. Besides even if they were different, why can I connect using QGIS.Any ideas would be much appreciated.
Hi, this is a beginner question. I couldn't find relevant tutorials for converting 3d formats including some basic information and hierarchy. For example:* Object names* Instancing* Materials* Textures.* Metadata* Transforms or scene hierarchyIdeally I would be converting 3d objects inside DWG files into GLTF that I could then import into a game engine. Possibly any example would get me past my mental block though, and could be generalised to other formats?
Hi,I am trying to write to a MS SQL Server Non-Spatial Writer but I keep getting the following error:Microsoft SQL Server Non-Spatial Writer: Failed to write attribute `PK_ID' of feature type `dbo.Txxxx'. Provider Error `(-2147467261) Invalid pointer'I have read through a number of posts on this forum about similar issues and have tried the following:Set the 'Command Timeout (seconds)' in the writer parameters to 600 seconds.Set Bulk Insert to 'No'.Installed Microsoft SQL Server 2012 Native client (64bit)However none of these things have helped.I am using FME Desktop version: FME(R) 2019.1.0.0 (20190710 - Build 19608 - WIN64).Does anyone have any other ideas on what could be causing this? This is my first time writing to MS SQL Server but I have read from MS SQL Server in the past with no issues.Thanks!
I am having problems trying to read a tag set from a DGN file. The 'title' view in the model holds some file metadata in 62 tags that I need to extract and potentially inlcude as attributes as part of a CAD to GIS translation. The 62 tags appear to be associated with a level that holds a single text element, but when I read the model I can't detect the tags. Any help on how I should be configuring the reader would be appreciated. But also confirmation of if the DGN model is correctly structured would also be good. I have attached a screenshot of the tag properties from the DGN model.
I have an .atomsvc file for a public streaming data service powered by SSRS Report Server. The file contains a URL for the report server with a bunch of default query parameters ending with "s%3ACommand=Render&rs%3AFormat=ATOM &rc%3ADataFeed=xAx0x0". I haven't had any luck using any part of this URL in the RSS reader.Is there any info on how to use an .atomsvc in FME anywhere? I haven't found anything useful.
Hello, I Have a dwg reader. I use a lot of transformer to have a an excel file which contains a list of points (Point) that form polygons (PARCELLE N°). I write the list like on the Print Screen 1 but it's not the result i would like. I want to have for each polygons a list of points and like in the Print Screen 2 where I write Parcelle N° in a cell and Surface in Another and below the list. The Polygons must be sorted PARCELLE N°. I must repeat the format for each polygons. The number of polygons and points is variable depending on the source dwg file. Can you help to do this or give me some tips? I think I must use some python code to solve question. I attach 3 excels files : - listing_surface_template.xlsx which is the templace I use. - listing_surfaces_exemple.xlsx which is the file I obtain with my workspace (Print Screen 1) - listing_surfaces_exemple_final.xlsx which is the file with the desired format (Print Screen 2). Print Screeen 1 Print Screen 2
I used an excel file as a reader, read in all needed features, do some calculations, then use the same excel file in featurewriter to update one cell in it. The process works if I enable the feature cache and run step by step. But a complete run encounters an error indicating the writer fails due to the excel file being open. I need the process to run in the same workbench so I can use FME parameter XLSX_ROW_ID for excel to locate which cell is to be updated. If I can close the excel reader after all features are read in, and let the feature writer open it again for update, that should work.
Hi list.I'm writing data to an SQL Server database, with full schema targets.My schema names often include a dash (e.g. "RSF-Aflob"), which freaks FME out, as it doesn't perform any form of escaping. It errs both when writing data, and even when I import attribute names to a transformer.Now, proper escaping is an integral part of database manipulations, so I wonder why it's omitted in FME ? FME do know which database type is in question (here: SQL Server which uses [xxx]), so escaping the proper way really is possible.Can anyone shed some light on this issue ? Should it not be promoted as a improvement request ?Cheers.
Hi, I'm using a FeatureWriter to export a bunch of data from an SDE Geodatabase to Shapefile format. The final product is not including the .sbn and .sbx files. Is there a way the FeatureWriter can include those files, or some other Transformer I can use?? Thanks,
Asking this on behalf of a customer:They recently upgraded to FME 2019 and are having some issues writing to SDE. If they write to an existing feature class they get this:Geodatabase Writer: The field 'OBJECTID' in table 'Afvalbakken' will not be updated since it is not editableA 3D feature was encountered in the feature class 'Afvalbakken', which is defined as containing 2D features. The feature, and any other applicable features in the same feature class, will be modified so that it has the same dimension as the feature classAn error occurred while attempting to insert a row into the table 'Afvalbakken' using a cursor. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {Klasse is niet geregistreerd}Writing to a new feature class leads toTransactions are being used by the Geodatabase WriterGEODATABASE_SDE writer: An unknown exception occurredAny suggestions?
Hi, I'm completely new to FME and was wondering if the following was possible, and if yes, how?I have DEM GeoTIFFS Greyscale 32 bit floatingpoint. We need to convert this to .pngs (or similar) where the rgb values/bands represent elevation, so maximum 1,6 million values. We want elevations for the world, so between -12000~ to +8868.The output is going to be png Tiled web map, like Google maps, TMS with zoom levels folders (for example 10,13,17 and 21). This will be used in a terrainsystem witha custom shader for elevation.Is this possible? If something is unclear please let me know. Any help is appreciated.Regards, Robin
From ESRI documentation it shows that they use the field GDB_GEOMATTR_DATA as an 'extra' way to store complex polygons. That is, if you want to use more than regular straight lines between the points of that polygon. Inmy case, that field only contains 'NULL' values, as I only use simple straight polygons.So far, so good in ArcGIS pro, but when you try to read the FCL in FME(2019.2) an error occurs that the row is not available. The only way is to exclude the field when you want to read the data. The problem is that you normally don't look for that field as this is not allways added to the FCL. Also FME_server cannot handle this field.The question: is there a way to get past this issue without having to think about field GDB_GEOMATTR_DATA, even better: I hope that FME will fix this reader issue.
Is there any way to write to an esri sde feature class with attribute rules and database sequences?
Hi,Is there a way to automatically create new coded domains into Esri Geodatabase (File Geodb) writers? I have all the domain information in an excel file. Is it possible to have a function to import the table into the coded domain window?Thanks.
Hi All, Just been playing around with the 3D PDF writer and have noticed that my output seems to be in mm rather than meters (AdobeReader has a measurement tool) I've turned off "Move to local Coordinate System" but the issue is still there. Is there a way to specify the unit in the writer? or is the only way to do this to scale the model so that the measurements are at least accurate?
Good afternoonI have a workbench that is using the sharepoint reader to to pull the contents of a list into fme, where when I run it fme reports Microsoft SharePoint List Reader: Client-side error: '404 Client Error: Not Found for url: https://........The list has ~95 fields in it (so quite a few and the url call is quite long). Through trial and error I have found that there are a couple of fields that if I exclude from the Reader the workbench runs ok. The fields are type string line of text in sharepoint. They have / characters in their names (but so do some of the other fields). None of the records in the list actual have any values entered in those fields at the moment (but there are others like that which read ok) and so I'm a little stuck as to what's causing the error.These are the 2 bad-eggs I dont' have any Features to Read parameters set in the Reader. Has anybody out there run into a similar issue with the sharepoint reader?@mark2atsafe I see a few share
I've been trying to upload an excel file to a shared drive on Google Drive using a GoogleDriveConnector and keep getting an upload error where it can't find the folder I'm sending it to (404 Client Error: Not Found for url). I can upload it fine to My Drive, but can't find a way to upload it to the shared drive. Has anyone had the same issue and found a way around it?