normal d9beb7690f net/protocol: optimize large read case ... There are several places where rbuf_consume is called with @rbuf.size as its length arg; simplify that case by avoiding the slow String#slice! operation in favor of a lightweight replacement. The following script exhibits reduced memory usage and runtimes using the time(1) command: 2.9s => 2.6s 70MB => 12 MB --------- require 'net/http' require 'digest/md5' Thread.abort_on_exception = true s = TCPServer.new('127.0.0.1', 0) len = 1024 * 1024 * 1024 th = Thread.new do c = s.accept c.readpartial(16384) c.write("HTTP/1.0 200 OK\r\nContent-Length: #{len}\r\n\r\n") IO.copy_stream('/dev/zero', c, len) c.close end addr = s.addr Net::HTTP.start(addr[3], addr[1]) do |http| http.request_get('/') do |res| dig = Digest::MD5.new res.read_body { |buf| dig.update(buf) # String#clear is important to reduce malloc overhead, # but most Ruby programmers don't do this :< buf.clear } puts dig.hexdigest end end ---------- * lib/net/protocol (rbuf_consume): optimize for @rbuf.size == len [Feature #14268] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@61602 b2dd03c8-39d4-4d8f-98ff-823fe69b080e		2018-01-05 02:22:23 +00:00
..
cgi	Use printf instead of puts and sprintf	2017-12-12 15:01:04 +00:00
drb	drb: use \A and \z	2017-12-30 12:10:43 +00:00
forwardable
irb	proc.c (bind_location): Add Binding#source_location	2017-12-26 08:38:35 +00:00
matrix
net	net/protocol: optimize large read case	2018-01-05 02:22:23 +00:00
optparse
racc	Fixed misspelling words.	2017-10-22 11:27:06 +00:00
rdoc	fix reset order.	2017-12-31 00:06:34 +00:00
rexml	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
rinda	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
rss	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
rubygems	fix leaked fds	2017-12-25 05:54:27 +00:00
shell	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
unicode_normalize	update Ruby to Unicode 10.0.0	2017-09-06 07:56:41 +00:00
uri	Use string instead of regexp	2017-12-14 06:30:22 +00:00
webrick	webrick 1.4.2	2017-12-24 08:38:43 +00:00
yaml
.document	Ignore gemspec under the lib directory for documentation.	2017-12-12 08:34:13 +00:00
abbrev.rb
base64.rb
benchmark.rb
cgi.rb
cmath.gemspec	Bump version to cmath-1.0.0 as default gems.	2017-12-11 03:27:47 +00:00
cmath.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
csv.gemspec	Bump version to csv-1.0.0 as default gems.	2017-12-13 05:24:01 +00:00
csv.rb	Merge csv-0.1.0 from upstream.	2017-09-12 08:38:06 +00:00
debug.rb
delegate.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
drb.rb
e2mmap.rb
English.rb	$IGNORECASE is no longer effective. [ci skip]	2017-08-25 15:47:04 +00:00
erb.rb	$SAFE as a process global state. [Feature #14250]	2017-12-28 20:09:24 +00:00
fileutils.gemspec	Bump up fileutils-1.0.2	2017-12-22 08:00:10 +00:00
fileutils.rb	Bump up fileutils-1.0.2	2017-12-22 08:00:10 +00:00
find.rb	Find.find -> Use Dir.children instead of Dir.entries	2017-09-15 17:00:49 +00:00
forwardable.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
getoptlong.rb	getoptlong.rb: multiline regexps	2017-09-02 02:05:34 +00:00
ipaddr.gemspec	Import ipaddr 1.2.0	2017-10-21 13:34:19 +00:00
ipaddr.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
irb.rb	irb.rb: fix highlight	2017-12-25 07:55:25 +00:00
logger.rb	* lib/logger.rb (Logger::LogDevice#open_logfile, #create_logfile):	2017-12-21 05:07:43 +00:00
matrix.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
mkmf.rb	int (*)(void) is incompatible with void*	2018-01-02 06:41:42 +00:00
monitor.rb	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
mutex_m.rb	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
observer.rb
open-uri.rb	open-uri defines URI.open defined as an alias.	2017-12-21 14:15:04 +00:00
open3.rb	lib/open3.rb: accept IO-like object for :stdin_data argument.	2017-10-21 07:00:58 +00:00
optionparser.rb
optparse.rb	optparse.rb: case-sensitive candidate	2017-07-24 01:56:04 +00:00
ostruct.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
pp.rb	Requiring pp is not required now [ci skip]	2017-12-18 01:51:53 +00:00
prettyprint.rb
prime.rb	prime.rb: remove alias after timeout test	2017-05-20 10:21:44 +00:00
profile.rb
profiler.rb
pstore.rb
rdoc.rb	Merge rdoc-6.0.1.	2017-12-23 23:33:09 +00:00
resolv-replace.rb
resolv.rb	Fixed command Injection	2017-12-20 04:25:01 +00:00
rss.rb
rubygems.rb	Postponing the Bundler merge.	2017-12-22 23:08:05 +00:00
scanf.gemspec	Bump version to scanf-1.0.0 as default gems.	2017-12-11 08:18:01 +00:00
scanf.rb	Fix bug about String#scanf("%a")	2017-10-21 12:34:13 +00:00
securerandom.rb	securerandom.rb: fix an example of choose [ci skip]	2017-10-25 07:28:22 +00:00
set.rb	lib/set.rb: [DOC] remove empty comments	2017-11-22 21:13:51 +00:00
shell.rb
shellwords.rb
singleton.rb	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
sync.rb
tempfile.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
thwait.rb	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
time.rb	Make Time.parse respect timezone offset seconds	2017-10-20 01:03:18 +00:00
timeout.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00
tmpdir.rb	tmpdir.rb: merged make_tmpname to create	2017-11-15 08:02:09 +00:00
tracer.rb	Remove unnecessary require 'thread'	2017-10-08 07:00:01 +00:00
tsort.rb
un.rb	un.rb: use OpenSSL::PKey.read instead of OpenSSL::PKey::RSA.new	2017-07-05 09:05:53 +00:00
uri.rb
weakref.rb	lib/weakref: Remove incorrect example [DOC] [Bug #14031]	2017-10-24 18:08:00 +00:00
webrick.rb
yaml.rb	Add uplevel keyword to Kernel#warn and use it	2017-12-12 11:56:25 +00:00