curl - Solr Blob Store API - Blob Too Big -


i trying use blob store api post jar .system collection can load custom solr plugin onto of nodes. trying post jar using:

curl -x post -h 'content-type: application/octet-stream' --data-binary @myjar.jar http://localhost:9002/solr/.system/blob/myjar 

but fat jar 81 mb , overflowing simpleposttool's buffer. there way increase this? i'm trying load custom solr plugin solr 6 cloud.

the error:

  "trace":"java.nio.bufferoverflowexception\n\tat org.apache.solr.util.simpleposttool.inputstreamtobytearray(simpleposttool.java:644)\n\tat org.apache.solr.handler.blobhandler.handlerequestbody(blobhandler.java:102)\n\tat org.apache.solr.handler.requesthandlerbase.handlerequest(requesthandlerbase.java:156)\n\tat org.apache.solr.core.solrcore.execute(solrcore.java:2036)\n\tat org.apache.solr.servlet.httpsolrcall.execute(httpsolrcall.java:657)\n\tat org.apache.solr.servlet.httpsolrcall.call(httpsolrcall.java:464)\n\tat org.apache.solr.servlet.solrdispatchfilter.dofilter(solrdispatchfilter.java:257)\n\tat org.apache.solr.servlet.solrdispatchfilter.dofilter(solrdispatchfilter.java:208)\n\tat org.eclipse.jetty.servlet.servlethandler$cachedchain.dofilter(servlethandler.java:1668)\n\tat org.eclipse.jetty.servlet.servlethandler.dohandle(servlethandler.java:581)\n\tat org.eclipse.jetty.server.handler.scopedhandler.handle(scopedhandler.java:143)\n\tat org.eclipse.jetty.security.securityhandler.handle(securityhandler.java:548)\n\tat org.eclipse.jetty.server.session.sessionhandler.dohandle(sessionhandler.java:226)\n\tat org.eclipse.jetty.server.handler.contexthandler.dohandle(contexthandler.java:1160)\n\tat org.eclipse.jetty.servlet.servlethandler.doscope(servlethandler.java:511)\n\tat org.eclipse.jetty.server.session.sessionhandler.doscope(sessionhandler.java:185)\n\tat org.eclipse.jetty.server.handler.contexthandler.doscope(contexthandler.java:1092)\n\tat org.eclipse.jetty.server.handler.scopedhandler.handle(scopedhandler.java:141)\n\tat org.eclipse.jetty.server.handler.contexthandlercollection.handle(contexthandlercollection.java:213)\n\tat org.eclipse.jetty.server.handler.handlercollection.handle(handlercollection.java:119)\n\tat org.eclipse.jetty.server.handler.handlerwrapper.handle(handlerwrapper.java:134)\n\tat org.eclipse.jetty.server.server.handle(server.java:518)\n\tat org.eclipse.jetty.server.httpchannel.handle(httpchannel.java:308)\n\tat org.eclipse.jetty.server.httpconnection.onfillable(httpconnection.java:244)\n\tat org.eclipse.jetty.io.abstractconnection$readcallback.succeeded(abstractconnection.java:273)\n\tat org.eclipse.jetty.io.fillinterest.fillable(fillinterest.java:95)\n\tat org.eclipse.jetty.io.selectchannelendpoint$2.run(selectchannelendpoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.executeproduceconsume.produceandrun(executeproduceconsume.java:246)\n\tat org.eclipse.jetty.util.thread.strategy.executeproduceconsume.run(executeproduceconsume.java:156)\n\tat org.eclipse.jetty.util.thread.queuedthreadpool.runjob(queuedthreadpool.java:654)\n\tat org.eclipse.jetty.util.thread.queuedthreadpool$3.run(queuedthreadpool.java:572)\n\tat java.lang.thread.run(thread.java:745)\n", 

the default size of object in blob store 5mb. can increase maximum size using -dblob.max.size.mb=nnn config value. mindful blobs kept on heap, , may need use runtimelib=true when creating request handler. (this information, , more, can found in following links.)

the wiki page, including comments @ bottom, informative. https://cwiki.apache.org/confluence/display/solr/blob+store+api

the solr jira ticket create blob store feature has discussion related default size: https://issues.apache.org/jira/browse/solr-6787


Comments