Using readers and writers to extract and load data.
Recently active
Hi,I have spent most of the morning going down a rabbit hole and really am none the wiser. I am writing out some content to a feature class in SDE. When I run the full process with feature caching on or off I get a failure to write with a very unhelpful ESRI error: An error occurred while attempting to insert a row into the table 'DBO.xxxx' using a cursor. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {}However if I run it with feature caching on, up to the last transformer and then run to the writer afterwards the content goes into the SDE, no error.If I write to a ffs file then push that to sde. It works. My suspicion is that I am using a feature reader, it seems like SDE doesnt recieve all the right info about the schema before FME tries to write to it, whereas it does when feature caching is enabled?Any ideas very much appreciated.ThanksOliver
I have several GML files that I read via the FeatureReader, and format =«GML» and reading all feature types. An unknown amount of these GML files results in Nested Attributes. Nested Attributes is appearing in the workflow as lists with one to several sub-levels. So far so good. But the problem occurs when I want to use the jsonpacker to create json strings that I am able to write to a PostGis table. The jsonpacker demands that I declare what attribute to pack. But making a generic workflow to handle any GML files and then pack all the lists without knowing the names of the lists at forehand, makes this a difficult task. I need one json string for every list, and the name of the json attribute should be the top level name in every list. So in stort : I am creating a generic workspace that packs all lists individually to just as many unique json string attributes. Sorry for not posting any pictures of the workspace, but all I have is a generic reader of GML files that results in an unkn
I'm working on setting up a script that reads in an Excel file. I'm merging the spreadsheet with another based on a unique column and the owner doesn't want the formulas in one column to be disturbed. They still want access to view the formula. Is it possible to write to that sheet but still preserve the formula?
Hi,I'm trying to figure out a way to create a couple of paramaters in my workflow so that the user can select from a picklist of SDE Connection Files and available Versions to use in the various FeatureReader transformers in the workflow. Is there a way to do this without hard-coding all the values in ahead of time?? Thanks,
Good morning,I have a lot of files to convert from .idgn (Bentley) format to .sp (Synchro Pro) file format.To do that in microstation, there is a specific plugin from Synchro to do that.I am looking a way to do that automatically for a lot of files at the same time, so I was thinking FME.I am not a FME expert but do you think it is possible to configure that ?Thank you.Best regards,
Hello all,I have the experience is that a FME workbench will never update or truncate the data of a writer after that a fault condition has raised in a FME workbench.I would like to know if this is the way an FME workbench works to be sure that our data will never be changed after a fault condition in a FME workbench.Could you inform us if my experience is correct? Thank you for your answer.
I need help with FME Data Streaming Service. I am having trouble serving up a pdf file in a browser. I am using the DataFile writer to write my pdf because my pdf comes in binary form. It all works in workbench, but when I try it in FME Server as a Data Stream it downloads the pdf with the workbench name and a .fmw as the extension. If I change the extension to .pdf my pdf is there and I can open this. I would think that FME should serve up the pdf with the file name I specified in the writer. Any help would be greatly appreciated.
I am using a Google Drive transformer for my project, but I was considering to make the URL I use to connect to my spreadsheet, public. So, there is no need to provide my credentials or any other person credentials in the process. Is it possible to do that?
I am working with many autocad files and trying to extract data from paper space objects. The objects i am trying to extract are mtext object (of type autocad_multi_text) I am trying to match up objects that start with a specific string to objects just below them. to do this i want to use the autocad alignment_x and ycoordinates. I have enabled the feature type format attributesneeded and do see many of the attributes populated in the visual preview.but not the ones i need. I can get the coordinates using a coordinate extractor but those are the lower left and will not help me select the adjacent below text that i need.
Hello to all, I have created with FME 2019 a CityGML file with the UtilityNetwork ADE extension. Some of the ADE feature types I am using are: Cable, ProtectiveElement, ConnectorComponent or PowerTransformer. These features have their own attributes according to the ADE specification but also, I added to them some generic attributes like: <gen:stringAttribute name="CableType"><gen:value>MT</gen:value></gen:stringAttribute>After that, I want to convert this CityGML files to other formats. To do this, I am trying to add a reader for this CityGML file (with the ADE extension), but it doesn’t recognize the generic attributes. In the CityGML reader, I have specified the parameters like that: And I I get all the feature types lo load: But when looking at the attributes of Cable for instance, I don’t see the generic ones on the list. I only see the ones from the ADE Specification: I also have tried to add a Generic reader, but the problem here is that it only identifie
I got a workspace that I run and as an output it creates one row with statistics.If I run the workspace the output is correct both with inspector and the row written to postgres.If I use another workspace with a workspace runner to run the workspace for multiple areas, one of my column values is 0 in every row.Any thoughts?
Hello everybody, FME Server 2020 establishes a successful connection to the Active Directory. User and password input from AD unsuccessful when SSO is activated. If SSO is deactivated, the login is successful. However, the use of SSO is incorrect. The following entry is in the log:INFORM RequestHandler thread 401831: Accepted new client connection from /127.0.0.1 on port 7071 The service account is configured with SPN on the FQDNThe service account is also used successfully for the Active Directroy connection. Settings in TomCat Properties are also made (Enable SSO URL) best regardsMartin
I have autocad drawings with mtext. however one group of text is not one mtext feature.They also are center justified. so in order for me to get a common x coordinate for all the rows in a group i had to make the reader explode mtext objects.1. now my first difficulty was to get the autocad_alignment_x. After exploding the mtext i now have this value.2. I need to collect only the text that is the same height, font and vicinity of the first text. (there are standard strings that i can use to get the first line).3. iterate through and separate each row of text into a separate attribute. then use the file name to merge that feature with another on the name of the file.no problem right?My idea is to get the x coord of the first text. then find the next text down by subtracting from the y coord. and so on until i have found all 12 pieces of the information. then i will have to send each value out to populate attributes.
I'm uploading objects to my S3 bucket using the S3Connector (Action: Upload) and I see that I can add metadata but it looks like I can't add any tags for my new object. The lifecycle rules in my bucket depend on my objects being properly tagged. Is there any way to achieve this?
I'm pulling my hair out trying to get filecopy writer to work. What I want to do is copy a folder (and it's sub-folders) to a new location and to rename the copied folder. I'm using user-parameters to prompt for the new folder name but I can't get the file copy to work properly. I've combed through old forums but haven't found anything helpful. I think I can do the renaming with a system caller but I still cant get the filecopy to work... Any help is much appreciated. I feel like this is fairly straight-forward, I'm still quite new to FME.
when try to read a table (attribute data only no geometry field ) using Esri ArcGIS Server Feature Service reader i get this error ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '-2147220652' and the message was: 'Failed to execute query.'. Details: '' A fatal error has occurred. Check the logfile above for details
Before describing my issue, I already looked into the list of posts underneath:KB-article: Working with soap serviceQuestion: HTTPCaller SOAP issuesQuestion: Help with SOAPQuestion: Connecting to SOAPQuestion: FME desktop SOAP service issue problemBecause I first didn't succeed, I also installed SoapUI, as advised by @daveatsafe. And within SoapUI everything works fine. When I go to FME and use the HTTPCaller, I get an "HTTP/1.1 404 Not found"In the header I already added the SOAPAction (both with and within double quotes) and also copied all the other header elements and values in the header request. But still no difference. I also tried WireShark to look into the POST-requests, but since they're all encoded, I do not seem to be able to find any differences (and I can't succeed in decoding them, which seems to be possible). What I did notice in SoapUI is a different URL the POST-request seems to be send to, but when questioning that at my client, they tell me to
Hello,I am splitting 49 Polygons from one shapefile to 49 separate shapefiles (see inputFile and fmw attached).In the logfile I get a :Shapefile Writer: Maximum number of open output files reached, caching additional features until end of translationThe translation is successful and neither a warning or an error is outputted (see test-fmw-log.txt attached)All shapefile concerned by the caching are corrupt and I get a:Worker 2876 > Shapefile Reader: File size and filesize record in header mismatch. File claims size of '108' bytes but is '112' on disk. Reading as many records as possible, but file may be corruptI am working with FME(R) 2019.2.0.0 (20191105 - Build 19801 - WIN64)I think, these kind of translations never had problem...Thanks for your support.Florian
What I want to do is to write a DWG, define the color of the lines ByLayer (autocad_color = 256) and set the Layer Color according to the feature. As the layer names are dynamically formed, I can not work with a template.When reading the forums this seems not to be possible. But when reading the documentation, it looks like it is, as the "Used by Reader or Writer" column says Both.https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/acad/Feature_Representation.htmSo just to be sure, is it possible to get this to work? I could create a template on the fly and use that one if needed. Maybe a template in DXFR12, as that format is open?
Hi Guys, is it possible to acces a view in an Oracle Spatial database by the Oracel Spatial Object reader? When I try to connect, the table list doesn't show any existing view. In case the reader doesn't support reading views, is there any workaround to get my view as a feature type into FME Workbench? Thanks for helping,Wolfgang
Hello everybody, We are looking for a solution to update a spatial index in a Esri SDE database after the Geodatabase_SDE writer has finished writing the data. We are going the work with FME Desktop 2020. The only solution we could find is making an python script and use this in the "Shutdown python script" event. Does anybody know an easier solution?Greetings from the Netherlands
Hello, I'm searching for a way to obtain the external shape of a laz file and turn it into a line or polygon for and shp output.I've found something but it force me to "convert" in fme the point cloud entity to a multiple point entity. The issue with that method is that is that take a long time to process and that is not adapted to my data covers entire cities and has billions of points.Do you have any Idea on how can I proceed ?Here an exemple of the kind of data i have :
Hi, I have X,Y,Z,R,G,B txt file that I want to convert it to RGB coloured point cloud. The Point cloud creates fine, however without RGB colour assigned to points. How to assign RGB values to point cloud based on attributes? Any help much appreciated.Thanks, M
Hi,i'm trying to read features from a GDB and to import them into another GDB. The two GDB are basically the same thing just that in the start GDB some features are defined as "Double" while in target GDB they are defined as "Float".When i inspect the data from the reader in Data inspector i can see that some features look f.e. like 2603368.3700000001 instead of 2603368.37 (they all have maximum 2 decimals) and when I write them in the target GDB the decimals are completly gone. I tried to round them with "AttributeRounder" before write them and to change the "User Attribute Type" in the writer but it didnt help. Can anyone see what I am doing wrong?Thank you very much
I'm trying to connect to a local instance of MySQL 8.0 using FME Desktop 2018. When I test the database connection I get the following error:Opening MYSQL_DB reader for dataset 'test1'Error connecting to MYSQL database('127.0.0.1','test1'): 'Can't initialize character set unknown (path: compiled_in)'I can successfully: 1. Connect to a remote MySQL database in FME Desktop.2. Connect to my local test1 table in QGIS (using the same credentials).3. Connect to my local test1 table using MySQL Workbench.Googling seems to suggest the error is related to the database or table collation, but I've confirmed that the collation settings are the same for my local database and remote database. Besides even if they were different, why can I connect using QGIS.Any ideas would be much appreciated.