Using readers and writers to extract and load data.
Recently active
Hi, all, as the title suggests, we bought FME Server on the back of this information on the FME Website which reads "Esri’s I3S format is perfect for streaming large, heterogeneous 3D data across internet platforms. Create FME workflows to bring your 3D objects, meshes and point clouds together as a scene layer package (SLPK). This format is easy to handle and is ready to use in the cloud, on the web, or on your mobile device." Of course, we have learnt that point clouds is not yet supported. Can we get an update on what date the point clouds will be supported? Also, in the meantime, I think the FME website should be updated to more accurately reflect capability.
I have a problem writing a date field in a Filegeodatabase (open API Fgdb Writer)As soon as I enter these date fields manually, nothing is put in the Fgdb.In the attribute creator I enter @DateTimeFormat(20240101,%d-%m-%Y) so this should work.What can I do to make this work?
Hi guys, I would like to run a network analysis. I red some articles about this using FME but I got stuck. Hopefully you can help me out. Input data:Polygons representing buildings Polygons representing parks. Line road networkFor each building I want to compute whether its possible to reach a park within 300m distance using the provided network. Could you give me support in the right direction?I tried to use the MeasureExtractor and NetworkCostCalculator but did not manage until now.This image shows the general idea, walking from a building via the red line to a park in green.
I am trying to use FeatureWriter to create tables in various different PostGIS databases. I am specifying the Database Connection (host, port, database) using attributes from the schema feature but I'm getting the following error:FeatureWriter (WriterFactory): MULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETMULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or FeatureWriter_0_DATASET or POSTGIS_DATASETIf I hardcode the database connection parameter the FeatureWriter works as expected, even with host and port still using attribute values. I have used the database attribute successfully on a FeatureReader in the same workspace so can't understand why it's not working here.Any suggestions on why this might not be working or how I could get around the problem would be much appreciated. ThanksTom
I recently posted a question on the r/fme subreddit but am reposting here to see if I have better luck. I’m including the reddit post for context in the Original Post Contents section below.Since creating the post, I ended up joining the attributes I needed from the JSON to my transformation table but at the cost of decreased performance, see the Update to Original Post section below. Original Post ContentsDoes anyone know if there's a way to easily load attributes from a simple JSON file to be used as Parameters in an FME workspace (Workbench 2022.2)?I want to be able to alter the values in the JSON file and have the changes reflected in the FME Parameters, instead of having to manually set each parameter in FME by hand when I want to make a change.Here's a portion of the JSON file I'm using. I've tried using the JSONFeature Reader in combination with VariableSetter/VariableReader and MultiVariableSetter/MultiVariableReader to some degree of success. However, it's far from perfect, be
Hi, when I create a new feature class in an ArcSDE Geodatabase (Oracle) the field “SE_ANNO_CAD_DATA” gets created automatically. Is it possible to disable this field in the writer? I did not find anything in the documentation about this.
HI, I have a gdb with a lot of feature classes and I need FME to search thoroug the content of each layer and give me the list of all attributes from each layer that meets certain tester requirements. I was thinking of usint Attribute Validator but the content of the gdb will be changing hence adding attributes manually to each tester is going to be very time consuming. I need FME to search thorouhg the content of each layer saved in the gdb and give me the attributes
Hello, I have received a GEOJSON file from a data supplier, which I would like to convert into a shapefile. Unfortunately, I am not able to extract the geometries with their corresponding attributes from this file. If I use the standard reader for JSON files, I can look at all attributes in the Inspector, but I have no geometries, only an object (?). If I integrate a ListExploder after the reader, I at least have all the objects that are integrated in the file, but I only ever see the first point of the object.My question now is how I can extract both the geometries and the corresponding attributes from the file and save them in a ShapeFile or similar?I attached a small sample. Thanks a lot
I have a feature class in a file geodatabase that I need to write to a hosted feature service that has different schema. Is there a way extract the values, modify them to match the other schema values, and update the feature service?
I am using FME in ArcGIS Pro and would like to know if there is a way to set QUOTED_IDENTIFIERS_IGNORE_CASE to TRUE in the Snowflake session before copying/creating a table. Otherwise, the table is created with quotation marks around the table and column names, then ArcGIS Pro cannot recognize the table.Thanks
The connection works fine; but when I try to read data i get: Error running query: Failed to acquire a SAS token for list on /__unitystorage/schemas/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/tables/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/_delta_log Exception: 403: Your token is missing the required scopes for this endpoint. What is wrong? --- I am quite new to databricks. Thank you.
Hi, I would like to have attribute values in one of the attribute tables in Shape file.Attribute value should be as shown below. How do I get the
Hi, I have simple workbench where outcome is saved as dynamic schema. Somehow, additional columns are added to attribute table of the feature classes in gdb. Any clue what is going on?
When setting the connections to Azure Database in FME Desktop, it does not have an option to use Active Directory Integrated authentication. It has only Windows and SQL Server Authentication. Is there possible to connect Azure Database by using Active Directory Integrate? Any help is very much appreciated.
I am reading a large xml dataset - about 80GB .gz file - and send each feature in a PythonCaller that simply dispatch the content in different .gz files according to the feature type (since multi-writer will keep all the content in memory/temporary files). Seems to work since I can see the size of the different files increasing. however, Since it is being running for 8 days now (yes, 8 days), I wonder if I could eventually improve the speed of the workbench - parallel reading, processing, ... whatever could help! Daniel
Hello all, very new user here. New to FME, point clouds, LiDAR, and all related. I'm having an issue where a LiDAR scan I'm attempting to visualize is only displaying correctly when I select 2D in the FME Data Inspector. So when I load the file in to FME, the following is displayed (I've panned and zoomed to make it more obvious what is going on):There is nothing but a long thin line even though the inspector recognizes I have loaded > 8 million points. However, when I switch to 2D (the button on the toolbar at the top), the following displays:This is in line with what I was expecting, a road with corners and holes in the road where the scanning vehicle passed cars. But again, it only displays like this in 2D.I understand this is likely a scan format issue. This scan is stored in a polar format based on WGS84, so I attempted to convert it to an XYZ format with a python algorithm a friend suggested to me. At first I thought it had worked, but that one was distorted also.
I am highlighting the sql logic i would use in database environment that i am looking to replicate here. It does not accept that logic.
HelloI took CityGML LOD2 RoofSurfaces (~1700) and textured them with an Orthofoto. If I write this to a 3D PDF or glTF it takes 1min and produces output of 50Mb in PDF and 15Mb in glTFIf I write the same data to an ESRI File GeoDB it takes 5h+ and produces a File GeoDB with ~6Gb size .What is going on here ? Do I need to specially treat the surfaces before writing them to the File GeoDB ?
I am working on an AutoCAD to AutoCAD conversion where I am changing the text of text and Mtext objects and writing out the changes. The AutoCAD writer uses the input file as a template as the only parts I want to change are the text elements (whether text/mtext/attributes in a block). I am having a problem where Text entities (autocad_entity = autocad_text) are being written as MText entities in the output which is effecting the positioning of the text. This is happening for all text entities (autocad_text), where I have and haven't made changes Is there any reason why text entities would be written as Mtext, when they are clearly defined as text entities in FME? I have posted some images of before and after below for reference:Text Settings in FME just before writingAutoCAD file read into FMEAutoCAD file written from FME
Hi everyone, I have encountered the following issue: when writing to a Spatialite database a polygon with more than one hole, only one hole is created and the others get lost (see attached workspace). By the way, everything goes fine if I write, for example, to shape or geopackage. I'm using FME 2022.2.5.0 (20230329 - Build 22795 - WIN64). Could it be a bug? Thanks
buffer transformer
Has anyone figured out how to read Overture maps data using FME yet? Looks like it should accept a spatial query but maybe it requires a custom reader. I tried using the AmazonAthena connector but didn't get anywhere... Overture documentation can be found here:https://github.com/OvertureMaps/data/blob/main/README.md#how-to-access-overture-maps-data Thanks in advance!Nic
Hi,hopefully someone had the same problem before and could help me.I'm trying to export annotations and features from ArcGIS sde connection to Microstation dgn. However, the justification of the text are slightly shifted to the right, compared to the original text (see picture below). I've tried many things with DGNStyler and also the attribute igds_justification. None of these helped. It seemed like the calculated origin point is always slightly right. Last but not least, I also extracted x and y of the extent of original annotations and set that to the exported features. But it seemed FME still calculated an insertion point (see https://community.safe.com/s/article/text-justification) when exporting to DGN, so that there is a shift.After that, I thought of calculating the centroid of the original bounding box and set that as igds_insertion_x and igds_insertion_y, but that didn't changed anything.Does someone know how to deactivitate the automated calculation of origin poi
Hi, I am wondering how it is possible to write generics attribute in CityGML? Any help appreciated :) Regards, Asher
in in FME Json Reader following,{"yourDateOfBirth":"15/08/1987"}become column yourDateOfBirth with a value of 15/08/1987, I need to convert to value 08/15/1987? Thanks