1
0
mirror of https://github.com/golang/go synced 2024-11-26 10:08:23 -07:00
go/src
Michael Pratt b6e81a5129 debug/buildinfo: read data in chunks
Rather than reading the entire data segment into memory, read it in
smaller chunks to keep memory usage low.

For typically Go binaries, this doesn't matter much. For those, we read
the .go.buildinfo section, which should be quite small. But for non-Go
binaries (or Go binaries with section headers stripped), we search the
entire loadable data segment, which could be quite large.

This reduces the time for `go version` on a 2.5GB non-Go binary from
~1.2s and 1GB RSS (!!) to ~1s and ~25MB RSS.

Fixes #68592.

Change-Id: I9218854c5b6f2aa1331f561ab0850a9fd62ef23b
Reviewed-on: https://go-review.googlesource.com/c/go/+/601459
Reviewed-by: Cherry Mui <cherryyz@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
2024-07-31 14:26:34 +00:00
..
archive archive: use slices and maps to clean up tests 2024-07-25 00:25:45 +00:00
arena
bufio
builtin
bytes bytes,strings,unicode/utf16: use slices to clean up tests 2024-07-24 18:45:08 +00:00
cmd cmd: add README generation for compiler + linker script tests 2024-07-31 13:21:20 +00:00
cmp
compress
container
context
crypto crypto/x509,embed: use slices to clean up tests 2024-07-24 16:44:15 +00:00
database/sql
debug debug/buildinfo: read data in chunks 2024-07-31 14:26:34 +00:00
embed crypto/x509,embed: use slices to clean up tests 2024-07-24 16:44:15 +00:00
encoding encoding: add TextAppender and BinaryAppender 2024-07-30 14:22:50 +00:00
errors
expvar
flag
fmt
go go/types: record pointer and parentheses in receiver expressions 2024-07-30 23:42:46 +00:00
hash
html
image
index/suffixarray
internal internal/coverage: add internal/stringslite to hard-coded coverpkg ID list 2024-07-30 14:19:02 +00:00
io go,internal,io,mime: use slices and maps to clean tests 2024-07-25 00:22:14 +00:00
iter
log cmd,log,net,runtime: simplify string prefix and suffix processing 2024-07-29 21:29:17 +00:00
maps
math
mime go,internal,io,mime: use slices and maps to clean tests 2024-07-25 00:22:14 +00:00
net net/http: match os.File.Readdir behavior in DotFileHiding 2024-07-30 23:08:52 +00:00
os os: rm unused code 2024-07-27 00:57:42 +00:00
path os,path/filepath,testing: use slices to clean up tests 2024-07-25 00:23:06 +00:00
plugin
reflect cmd/compile, reflect: treat abi.NoEscape as cheap call 2024-07-26 16:18:47 +00:00
regexp regexp: allow patterns with no alternates to be one-pass 2024-07-24 01:01:48 +00:00
runtime runtime: make TestDebugLogInterleaving much more robust 2024-07-30 17:16:52 +00:00
slices
sort
strconv
strings bytes,strings,unicode/utf16: use slices to clean up tests 2024-07-24 18:45:08 +00:00
structs
sync
syscall
testdata
testing os,path/filepath,testing: use slices to clean up tests 2024-07-25 00:23:06 +00:00
text
time
unicode bytes,strings,unicode/utf16: use slices to clean up tests 2024-07-24 18:45:08 +00:00
unique
unsafe
vendor all: update vendored dependencies 2024-07-23 20:29:12 +00:00
all.bash
all.bat
all.rc
bootstrap.bash
buildall.bash
clean.bash
clean.bat
clean.rc
cmp.bash
go.mod all: update vendored dependencies 2024-07-23 20:29:12 +00:00
go.sum all: update vendored dependencies 2024-07-23 20:29:12 +00:00
make.bash
make.bat
Make.dist
make.rc
race.bash
race.bat
README.vendor
run.bash
run.bat
run.rc

Vendoring in std and cmd
========================

The Go command maintains copies of external packages needed by the
standard library in the src/vendor and src/cmd/vendor directories.

There are two modules, std and cmd, defined in src/go.mod and
src/cmd/go.mod. When a package outside std or cmd is imported
by a package inside std or cmd, the import path is interpreted
as if it had a "vendor/" prefix. For example, within "crypto/tls",
an import of "golang.org/x/crypto/cryptobyte" resolves to
"vendor/golang.org/x/crypto/cryptobyte". When a package with the
same path is imported from a package outside std or cmd, it will
be resolved normally. Consequently, a binary may be built with two
copies of a package at different versions if the package is
imported normally and vendored by the standard library.

Vendored packages are internally renamed with a "vendor/" prefix
to preserve the invariant that all packages have distinct paths.
This is necessary to avoid compiler and linker conflicts. Adding
a "vendor/" prefix also maintains the invariant that standard
library packages begin with a dotless path element.

The module requirements of std and cmd do not influence version
selection in other modules. They are only considered when running
module commands like 'go get' and 'go mod vendor' from a directory
in GOROOT/src.

Maintaining vendor directories
==============================

Before updating vendor directories, ensure that module mode is enabled.
Make sure that GO111MODULE is not set in the environment, or that it is
set to 'on' or 'auto', and if you use a go.work file, set GOWORK=off.

Requirements may be added, updated, and removed with 'go get'.
The vendor directory may be updated with 'go mod vendor'.
A typical sequence might be:

    cd src  # or src/cmd
    go get golang.org/x/net@master
    go mod tidy
    go mod vendor

Use caution when passing '-u' to 'go get'. The '-u' flag updates
modules providing all transitively imported packages, not only
the module providing the target package.

Note that 'go mod vendor' only copies packages that are transitively
imported by packages in the current module. If a new package is needed,
it should be imported before running 'go mod vendor'.