Greetings,
Once in a while, our workbench using the "dataupload" service seems to return an error 500. We do not see any logs related to disk space, nor should it as it is only using ~20% of the available space. The following log is shown in the logs of "Resources -> Logs -> service -> current -> fmeserverweb_dataupload.log":
1Fri-12-Feb-2021 07:55:46.873 AM INFORM http-nio-8080-exec-22 419011 : Creating new request object: path level = "1", requested path = "", session ID = "f257b28e-bdd2-49df-84eb-007d69dabc5e", uploaded files = [], workspace path = "/<repository>/<wb_name>.fmw", retrieve absolute paths = "true", extract files = "false"2java.io.IOException: Unable to create directory: /data/fmeserverdata/resources/system/temp/upload/<repository>/<wb_name>.fmw/f257b28e-bdd2-49df-84eb-007d69dabc5e3 at COM.safe.web.upload.StoreManager.setup(StoreManager.java:232)4 at COM.safe.web.upload.StoreManager.<init>(StoreManager.java:226)5 at COM.safe.web.upload.StoreManager.acquire(StoreManager.java:253)6 at COM.safe.webservices.upload.VolatileUploadServlet.doPost(VolatileUploadServlet.java:245)7 at javax.servlet.http.HttpServlet.service(HttpServlet.java:661)8 at COM.safe.webservices.upload.VolatileUploadServlet.service(VolatileUploadServlet.java:72)9 at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)10 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)11 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)12 at COM.safe.webservices.utility.ServiceAuthFilter.doFilter(ServiceAuthFilter.java:64)13 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)14 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)15 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)16 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)17 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)18 at org.ebaysf.web.cors.CORSFilter.handleNonCORS(CORSFilter.java:640)19 at org.ebaysf.web.cors.CORSFilter.doFilter(CORSFilter.java:173)20 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)21 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)22 at COM.safe.webservices.AcceptMIMEAdapterFilter.doFilter(AcceptMIMEAdapterFilter.java:409)23 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)24 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)25 at COM.safe.web.servlet.CharsetEncodingFilter.doFilter(CharsetEncodingFilter.java:541)26 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)27 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)28 at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198)29 at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)30 at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493)31 at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)32 at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)33 at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:650)34 at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)35 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342)36 at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:800)37 at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)38 at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:800)39 at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1471)40 at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)41 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)42 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)43 at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)44 at java.lang.Thread.run(Thread.java:748)45Fri-12-Feb-2021 07:55:46.874 AM ERROR http-nio-8080-exec-22 419012 : Request failure, status 500, Unable to create directory: /data/fmeserverdata/resources/system/temp/upload/<repository>/<wb_name>.fmw/f257b28e-bdd2-49df-84eb-007d69dabc5e
Note, if we try this again it seems to work fine. Is there anything specific reason for this behaviour, or is there a lead that I may follow for debugging?