Using readers and writers to extract and load data.
Recently active
Hi,One of my FME projects is 90% done. The only thing that's stopping me from completing it (and putting it into automation) is the issue that I'm having with excel reader. FME seems giving me errors sometimes (not always) at the excel reader (Feature Reader) (which reads an excel file from our own Share Point site). It works fine if I go to the SharePoint site by myself before running the script (or poke around the transformers either by parameters button, or containing folders button, etc.), which for me it indicates the problem is about the access to the file/site. But how do I mitigate this problem. Can someone please help? Thanks.
Hi, I want to access the property sets a of a dwg in FME.I enabled the 'Civil 3D and CAD Entities' option in the Schema Mode of the Civil 3D Reader.When i attach an inspector to the reader, I get a fatal error.AutoCAD Reader: An error occurred for dataset 'C:\\Users\\wisbeja\\Documents\\AWV\\FME voor dataconversie DAVIE\\voorbeeld data\\DWG solid and prop set\\small_test.dwg', in function AutoCAD2004Reader::read. Exception thrown: 'Invalid ResBuf' (Invalid ResBuf)A fatal error has occurred. Check the logfile above for detailsdwg file is attached.When I read the dwg with a dxf/dwg reader the inspector works. But I guess I am not able to access the property sets with this reader. Any suggestions? Jasper
Unable to correctly convert DGN which contains MicroStation traditional curves and Bspline curves. The resulted curves are stroked incorrectly. What is needed that stroked line follows curves more accurate. The undocumented parameter for dgn reader "Number of interpolated curve vertices" works for curves but not for Bsplines.DGN reader :: Result is not as expected
I have a workbench to look at changes between a new worksheet and an old worksheet. These data populate three tabs in a workbook: "changed", "deleted", "updated". The intial run populated the deleted tab with a few records that had been deleted. I re-ran the workbench with matching data and the "deleted data" remained on the deleted tab. I would like the data on the tabs to be overwritten each time.
Hello all,Does anyone know how to determine if a layer in an autocad file is frozen in a viewport?I need to determine if model_space features are visible in a particular viewport. I have done this by reprojecting the viewport's geometry to model space and then testing if it contains the feature. This works well, however in autocad you can freeze a layer in a viewport, in which case that layer is not drawn in that viewport and I need to account for this. I can see the features have an "autocad_layer_frozen" attribute, however this seems to define if the layer as whole is frozen not if it is frozen in a particular viewport.The viewport's extended_data_list list include's the frozen layer's name: In this case "LSSA-DIST_ANNO". However I don't know how to parse the extended_data_list.I could just search the entire extended_data_list for the layer's name, however I am worried that there may be cases where the layer's name appears in the exten
I want to export some data to gml, and I see that I have some complex geometries, which results in different sets of coordinates for each polygon (after geometry extractor). I made a list and each element within the list contains the set of coordinates for each segment of the geometry, but not all the polygons have the extra dimensions. Therefore, I want to make an if-statement where only the extra xml-statement is shown when there is data in the list. I tried using this, but it does not work. Can anybody point out an error in the statement.Not only the line with the statement posList..., but also the other statements around them, I want to delete when the list element is not existing. If there is another way of doing this (e.g. with a loop), I am open to suggestions. </gml:exterior> If {(fme:has-attribute("interior_xy_l{0}.part")) then ( <gml:exterior> <gml:LinearRing> <gml:posList&g
Hi, I'm having trouble connecting to a public S3 bucket. I have a file i would like to download from this bucket however when configuring the S3 connector transformer I get the error message 'NoneType' object has no attribute 'lower'. I have upgraded the transformer and i'm using FME 2019.1. Screen shots of the configuration and translation log error message below.Any help or guidance greatly appreciated. File "contextlib.py", line 112, in __enter__ File "C:\Program Files\FME 2019\python\pypac\api.py", line 273, in pac_context_for_url pac = get_pac() File "C:\Program Files\FME 2019\python\pypac\api.py", line 57, in get_pac return PACFile(downloaded_pac, **kwargs) File "C:\Program Files\FME 2019\python\pypac\parser.py", line 62, in __init__ context.FindProxyForURL('/', '0.0.0.0') File "C:\Program Files\FME 2019\python\js2py\base.py", line 1120, in __call__ return to_python(parent._obj.callprop(meth, *args)) File "C:\Program Files\FME 2019\python\js2py\base.py", line
Hi there,I am trying to write FME transformed data to AGOL using AGOL writer. Here are my steps for writing AGOL:1) Created feature class on AGOL that has the same number and name of fields as it is in FME transformation.2) Use AGOL writer and set the constraints Feature service to the same feature layer created in the first step. 3) Give a name to writer the same as the feature class has. When I run the transformation, it throws an error and states that 0 features successfully written to the layer. Please note that data on the FME transformation does not have field/attribute called Object_ID. When I go to the AGOL, I found that 851 out of 24435 features were present online. Could anyone help me where am I making the mistake?
Hi, Is it possible to download/read an excel file from SharePoint? I can read the contents of the site using the SharePoint list reader, but unsure if I can then actually read a spreadsheet stored there? Thanks, Sam
Hi,The file path was working fine on Workbench but it's giving me this error when I put the FME script in Task Scheduler (or Command Line).
I have a workbench to read a bunch of large KMZs which I create a surrounding polygon with some attributes and write out to one master KMZ. What I want to have in each output feature is a Network Link to the detailed original KMZ but cannot figure out how to do this. I saw in an FME tutorial, Optimizing Large Datasets for KML and Google Earth, where they created Network Links by setting the output feature type to NetworkLink and populated kml_link_href and kml_link_name which I was able to do but all it did was read the referenced KMZ and put all of it's elements into my output KMZ which seems to defeat the purpose of a Network Link being a user clickable link. Is it possible in FME to create a clickable link in my output KMZ that would open the referenced KMZ ?
I have a workspace that is trying to upload a bytearray into an existing PostGIS table, into a ByteA column. The data is generated in a python caller.Using INSERT, this works fine. There is no problem, and the resulting data can be read from a different client as expected.However, using UPDATE it fails, stating:Error executing SQL command ('update "public"."mesh_test" set "ogc_fid" = 694,"mesh" = E'\003\000\000\000\212\032\005H\004\362\336H33C@g\032\005H&\362\336H\205\353\021@\354\031\005H\004\362\336H\205\353\021@\001\000\000\000\000\000\000\000\002\000\000\000\001\000\000\000' WHERE "ogc_fid" = E'694''): 'ERROR: invalid byte sequence for encoding "UTF8": 0x00I can circumvent the error by encoding it into base64, but that yields data I can't interpret from another client.It seems that the update statement is done using a different method than the insert statement, which is odd. Has anyone seen this before?EDIT: Added example workspace, plus sqlfile to create and populate table. Y
Hi, Im trying to write data to an xlsw writer where i want for each partner a seperate excel file with a sheet for each municipality.So i tried to create a writer where i set my sheet name to an variabel attribute (gemeente) and then by the fanout option i tried the variabel attribute "gegevenspartner". But is doesn't work, what am i doing wrong?
Does anyone know if there is an attribute or attributes that can be read from a DWG file that will define the linestyle i.e. if it is a dashed line what are the line lengths and the space lengths?
I'm looking to check and compare the collected lidar coverage against a given AOI. In other software's I have used the bounding box feature however FME boundingbox transformer looks to only create rectangular bounding boxes. Any insight would be much appreciated.
HiI am trying to write hyperlinks to a powerpoint but it fails and I get this message:AttrDecoder: Unable to parse line table attribute 'link'. Please update transformer and retry. If problem persists, please contact technical supportError encountered while calling method `input'PowerPointStyler_8_CALLER (PythonFactory): PythonFactory failed to process featureA fatal error has occurred. Check the logfile above for detailsI have created an attribute called link = <a href="@Value(url_1)">link text</a>Br,Felipe Verdú
CSVJoiner2.fmwI have many CSV files in a folder that I want to join together based on attribute in first column of every file. Each file has about 300 records and 50 attributes. I want my output excel sheet to have 300 rows with all attributes from all the input files, joined by the code in "Col0"I've tried DatabaseJoiner and my output has all the input column names, but only the values from the first input table. See attached two CSV files and workspace.
I am trying to create a weekly summary report using data from multiple CSV's. Currently I have each CSV writing to multiple sheets within an xlsx file, but ideally I would like to write all of the CSV's in succession in one sheet. The issue is that the CSV's do not have the same name or number of columns and when they all write to one sheet with FeatureWriter it creates duplicate columns and blank cells.On the attached xlsx, Sheet1 shows how I would like the final sheet formatted and Sheet2 is how the writer is currently combining the CSVs. Thank you in advance!
I attempt to add a file geodatabase reader for this database (D:\\Workspaces\\My FME Workspaces\\Support\\AnnoFClassError\\CompetitorLeasesArcGISPro.gdb\\CompetitorLeases) and I get the following error: |WARN |Unable to read from the table/feature class 'CompetitorLeases_Anno'. If 'CompetitorLeases_Anno' contains a class extension, make sure it is registered on this computer. A reader is added, but no featureclass.The annotation layer was created by ArcGIS Pro 2.2, but I'm using FME 2018.1 and the email I received today claimed that the ArcGIS Readers/Writers are upgraded for ArcGIS Pro 2.2.Has anyone else experienced this and have a suggestion?
Hi! Im having trouble producing a 3D mesh from my point cloud (.las). I'm using the PointCloudSurfaceBuilder which seems to be just what I'm looking for, but the process halts after some warnings in the translation logg."PointCloudManipulatorFactory: Converting 'x' from type 'Real64' to 'Real32'. If this conversion is undesired, consider changing the type explicitly." (seen below)This line is said for x,y,z and a similar line for "color_xxx" and is undesired. The PointCloudCoercer > Output Geometry: Singel multipoint makes these warnings go away, but instead redirects the process into "Rejected".Does anyone know how to proceed with this? Any clues is much appreciated!!
Hi I have setup fme server 2019, as a fault tolerant on 2 server, with share and a SQL Server Database in HA clusterWe are using netscaler for load balancing, but the documentation is not very clear on how to config the load balancer partI am struggling to get the topic monitoring working for fault tolerant, and IT also unsure how to configureour load balncer has been setup as http://gisfmelb:8080, and it opens up the fme server GUI interface, this seems to work OK.but configuring the monitoring on port 7078 for websocket, we can't seem to get it right.i am receiving this error on topic monitoring service i was not sure, on the url you need for topic monitoring, setup as - ws://gisfmelb:7078/websocketattached are the netscaler config settings, for review
I have a workbench that is taking a DWG and converts it to a PDF and then I want it to also create a TIFF of the PDF. If I have a normal PDF writer it works fine but if I try and add a FeatureWriter that creates the PDF and feed that to another FeatureWriter to create the TIFF it fails. I have attached my workspace and a sample drawing I could create a separate workbench reads the PDF and outputs the TIFF after the first one runs but was hoping to do it withing the same workbench.
Hi Everyone, I am fairly new to FME, so please be patient with me! I have some As-Builts in PDF format that I need to convert to TIFF format as part of a monthly update to an external stakeholder (individual PDFs to individual TIFFs). I have attempted to use the Adobe Geospatial PDF reader and translate it to the TIFF/GEOTIFF writer, but to no avail. I keep getting an error message "Failed to obtain raster from feature. Only features with raster geometry are expected"; this is despite having 'Read Rasterized Pages' set to 'Yes'. I would appreciate any help and suggestions that can be offered! Thanks in advance!
How do I retrieve the setting for Global Width on the geometries?
I converted from dgn file to esri shaoe file but it does not work properly .could soemone provide me what am i missing to do .to get all attributes and also coordinate in output Thanks