Using readers and writers to extract and load data.
Recently active
Good morning,I have a lot of files to convert from .idgn (Bentley) format to .sp (Synchro Pro) file format.To do that in microstation, there is a specific plugin from Synchro to do that.I am looking a way to do that automatically for a lot of files at the same time, so I was thinking FME.I am not a FME expert but do you think it is possible to configure that ?Thank you.Best regards,
Hello all,I have the experience is that a FME workbench will never update or truncate the data of a writer after that a fault condition has raised in a FME workbench.I would like to know if this is the way an FME workbench works to be sure that our data will never be changed after a fault condition in a FME workbench.Could you inform us if my experience is correct? Thank you for your answer.
I need help with FME Data Streaming Service. I am having trouble serving up a pdf file in a browser. I am using the DataFile writer to write my pdf because my pdf comes in binary form. It all works in workbench, but when I try it in FME Server as a Data Stream it downloads the pdf with the workbench name and a .fmw as the extension. If I change the extension to .pdf my pdf is there and I can open this. I would think that FME should serve up the pdf with the file name I specified in the writer. Any help would be greatly appreciated.
I am using a Google Drive transformer for my project, but I was considering to make the URL I use to connect to my spreadsheet, public. So, there is no need to provide my credentials or any other person credentials in the process. Is it possible to do that?
I am working with many autocad files and trying to extract data from paper space objects. The objects i am trying to extract are mtext object (of type autocad_multi_text) I am trying to match up objects that start with a specific string to objects just below them. to do this i want to use the autocad alignment_x and ycoordinates. I have enabled the feature type format attributesneeded and do see many of the attributes populated in the visual preview.but not the ones i need. I can get the coordinates using a coordinate extractor but those are the lower left and will not help me select the adjacent below text that i need.
Hello to all, I have created with FME 2019 a CityGML file with the UtilityNetwork ADE extension. Some of the ADE feature types I am using are: Cable, ProtectiveElement, ConnectorComponent or PowerTransformer. These features have their own attributes according to the ADE specification but also, I added to them some generic attributes like: <gen:stringAttribute name="CableType"><gen:value>MT</gen:value></gen:stringAttribute>After that, I want to convert this CityGML files to other formats. To do this, I am trying to add a reader for this CityGML file (with the ADE extension), but it doesn’t recognize the generic attributes. In the CityGML reader, I have specified the parameters like that: And I I get all the feature types lo load: But when looking at the attributes of Cable for instance, I don’t see the generic ones on the list. I only see the ones from the ADE Specification: I also have tried to add a Generic reader, but the problem here is that it only identifie
I got a workspace that I run and as an output it creates one row with statistics.If I run the workspace the output is correct both with inspector and the row written to postgres.If I use another workspace with a workspace runner to run the workspace for multiple areas, one of my column values is 0 in every row.Any thoughts?
Hello everybody, FME Server 2020 establishes a successful connection to the Active Directory. User and password input from AD unsuccessful when SSO is activated. If SSO is deactivated, the login is successful. However, the use of SSO is incorrect. The following entry is in the log:INFORM RequestHandler thread 401831: Accepted new client connection from /127.0.0.1 on port 7071 The service account is configured with SPN on the FQDNThe service account is also used successfully for the Active Directroy connection. Settings in TomCat Properties are also made (Enable SSO URL) best regardsMartin
I have autocad drawings with mtext. however one group of text is not one mtext feature.They also are center justified. so in order for me to get a common x coordinate for all the rows in a group i had to make the reader explode mtext objects.1. now my first difficulty was to get the autocad_alignment_x. After exploding the mtext i now have this value.2. I need to collect only the text that is the same height, font and vicinity of the first text. (there are standard strings that i can use to get the first line).3. iterate through and separate each row of text into a separate attribute. then use the file name to merge that feature with another on the name of the file.no problem right?My idea is to get the x coord of the first text. then find the next text down by subtracting from the y coord. and so on until i have found all 12 pieces of the information. then i will have to send each value out to populate attributes.
I'm uploading objects to my S3 bucket using the S3Connector (Action: Upload) and I see that I can add metadata but it looks like I can't add any tags for my new object. The lifecycle rules in my bucket depend on my objects being properly tagged. Is there any way to achieve this?
I'm pulling my hair out trying to get filecopy writer to work. What I want to do is copy a folder (and it's sub-folders) to a new location and to rename the copied folder. I'm using user-parameters to prompt for the new folder name but I can't get the file copy to work properly. I've combed through old forums but haven't found anything helpful. I think I can do the renaming with a system caller but I still cant get the filecopy to work... Any help is much appreciated. I feel like this is fairly straight-forward, I'm still quite new to FME.
when try to read a table (attribute data only no geometry field ) using Esri ArcGIS Server Feature Service reader i get this error ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '-2147220652' and the message was: 'Failed to execute query.'. Details: '' A fatal error has occurred. Check the logfile above for details
Before describing my issue, I already looked into the list of posts underneath:KB-article: Working with soap serviceQuestion: HTTPCaller SOAP issuesQuestion: Help with SOAPQuestion: Connecting to SOAPQuestion: FME desktop SOAP service issue problemBecause I first didn't succeed, I also installed SoapUI, as advised by @daveatsafe. And within SoapUI everything works fine. When I go to FME and use the HTTPCaller, I get an "HTTP/1.1 404 Not found"In the header I already added the SOAPAction (both with and within double quotes) and also copied all the other header elements and values in the header request. But still no difference. I also tried WireShark to look into the POST-requests, but since they're all encoded, I do not seem to be able to find any differences (and I can't succeed in decoding them, which seems to be possible). What I did notice in SoapUI is a different URL the POST-request seems to be send to, but when questioning that at my client, they tell me to
Hello,I am splitting 49 Polygons from one shapefile to 49 separate shapefiles (see inputFile and fmw attached).In the logfile I get a :Shapefile Writer: Maximum number of open output files reached, caching additional features until end of translationThe translation is successful and neither a warning or an error is outputted (see test-fmw-log.txt attached)All shapefile concerned by the caching are corrupt and I get a:Worker 2876 > Shapefile Reader: File size and filesize record in header mismatch. File claims size of '108' bytes but is '112' on disk. Reading as many records as possible, but file may be corruptI am working with FME(R) 2019.2.0.0 (20191105 - Build 19801 - WIN64)I think, these kind of translations never had problem...Thanks for your support.Florian
What I want to do is to write a DWG, define the color of the lines ByLayer (autocad_color = 256) and set the Layer Color according to the feature. As the layer names are dynamically formed, I can not work with a template.When reading the forums this seems not to be possible. But when reading the documentation, it looks like it is, as the "Used by Reader or Writer" column says Both.https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/acad/Feature_Representation.htmSo just to be sure, is it possible to get this to work? I could create a template on the fly and use that one if needed. Maybe a template in DXFR12, as that format is open?
Hi Guys, is it possible to acces a view in an Oracle Spatial database by the Oracel Spatial Object reader? When I try to connect, the table list doesn't show any existing view. In case the reader doesn't support reading views, is there any workaround to get my view as a feature type into FME Workbench? Thanks for helping,Wolfgang
Hello everybody, We are looking for a solution to update a spatial index in a Esri SDE database after the Geodatabase_SDE writer has finished writing the data. We are going the work with FME Desktop 2020. The only solution we could find is making an python script and use this in the "Shutdown python script" event. Does anybody know an easier solution?Greetings from the Netherlands
Hello, I'm searching for a way to obtain the external shape of a laz file and turn it into a line or polygon for and shp output.I've found something but it force me to "convert" in fme the point cloud entity to a multiple point entity. The issue with that method is that is that take a long time to process and that is not adapted to my data covers entire cities and has billions of points.Do you have any Idea on how can I proceed ?Here an exemple of the kind of data i have :
Hi, I have X,Y,Z,R,G,B txt file that I want to convert it to RGB coloured point cloud. The Point cloud creates fine, however without RGB colour assigned to points. How to assign RGB values to point cloud based on attributes? Any help much appreciated.Thanks, M
Hi,i'm trying to read features from a GDB and to import them into another GDB. The two GDB are basically the same thing just that in the start GDB some features are defined as "Double" while in target GDB they are defined as "Float".When i inspect the data from the reader in Data inspector i can see that some features look f.e. like 2603368.3700000001 instead of 2603368.37 (they all have maximum 2 decimals) and when I write them in the target GDB the decimals are completly gone. I tried to round them with "AttributeRounder" before write them and to change the "User Attribute Type" in the writer but it didnt help. Can anyone see what I am doing wrong?Thank you very much
I'm trying to connect to a local instance of MySQL 8.0 using FME Desktop 2018. When I test the database connection I get the following error:Opening MYSQL_DB reader for dataset 'test1'Error connecting to MYSQL database('127.0.0.1','test1'): 'Can't initialize character set unknown (path: compiled_in)'I can successfully: 1. Connect to a remote MySQL database in FME Desktop.2. Connect to my local test1 table in QGIS (using the same credentials).3. Connect to my local test1 table using MySQL Workbench.Googling seems to suggest the error is related to the database or table collation, but I've confirmed that the collation settings are the same for my local database and remote database. Besides even if they were different, why can I connect using QGIS.Any ideas would be much appreciated.
Hi, this is a beginner question. I couldn't find relevant tutorials for converting 3d formats including some basic information and hierarchy. For example:* Object names* Instancing* Materials* Textures.* Metadata* Transforms or scene hierarchyIdeally I would be converting 3d objects inside DWG files into GLTF that I could then import into a game engine. Possibly any example would get me past my mental block though, and could be generalised to other formats?
Hi,I am trying to write to a MS SQL Server Non-Spatial Writer but I keep getting the following error:Microsoft SQL Server Non-Spatial Writer: Failed to write attribute `PK_ID' of feature type `dbo.Txxxx'. Provider Error `(-2147467261) Invalid pointer'I have read through a number of posts on this forum about similar issues and have tried the following:Set the 'Command Timeout (seconds)' in the writer parameters to 600 seconds.Set Bulk Insert to 'No'.Installed Microsoft SQL Server 2012 Native client (64bit)However none of these things have helped.I am using FME Desktop version: FME(R) 2019.1.0.0 (20190710 - Build 19608 - WIN64).Does anyone have any other ideas on what could be causing this? This is my first time writing to MS SQL Server but I have read from MS SQL Server in the past with no issues.Thanks!
I am having problems trying to read a tag set from a DGN file. The 'title' view in the model holds some file metadata in 62 tags that I need to extract and potentially inlcude as attributes as part of a CAD to GIS translation. The 62 tags appear to be associated with a level that holds a single text element, but when I read the model I can't detect the tags. Any help on how I should be configuring the reader would be appreciated. But also confirmation of if the DGN model is correctly structured would also be good. I have attached a screenshot of the tag properties from the DGN model.
I have an .atomsvc file for a public streaming data service powered by SSRS Report Server. The file contains a URL for the report server with a bunch of default query parameters ending with "s%3ACommand=Render&amp;rs%3AFormat=ATOM &amp;rc%3ADataFeed=xAx0x0". I haven't had any luck using any part of this URL in the RSS reader.Is there any info on how to use an .atomsvc in FME anywhere? I haven't found anything useful.