sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

cockroach-teamcity · 2022-12-13T19:43:34Z

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3806512468/?referrer=webhooks_plugin

Panic message:

panic.go:1038: runtime: allocation size out of range
(1) attached stack trace
-- stack trace:
| runtime.gopanic
| /opt/ooce/go-1.17/src/runtime/panic.go:1038
| runtime.newarray
| /opt/ooce/go-1.17/src/runtime/malloc.go:1254
| reflect.unsafe_NewArray
| /opt/ooce/go-1.17/src/runtime/malloc.go:1261
| reflect.MakeSlice
| /opt/ooce/go-1.17/src/reflect/value.go:2657
| reflect.grow
| /opt/ooce/go-1.17/src/reflect/value.go:2394
| reflect.Append
| /opt/ooce/go-1.17/src/reflect/value.go:2403
| github.com/gogo/protobuf/proto.(*mergeInfo).computeMergeInfo.func27
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:542
| github.com/gogo/protobuf/proto.(*mergeInfo).merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:139
| github.com/gogo/protobuf/proto.(*InternalMessageInfo).Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/table_merge.go:50
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descpb.(*TableDescriptor).XXX_Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descpb/structured.pb.go:2080
| github.com/gogo/protobuf/proto.Merge
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/clone.go:95
| github.com/gogo/protobuf/proto.Clone
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/vendor/github.com/gogo/protobuf/proto/clone.go:52
| github.com/cockroachdb/cockroach/pkg/util/protoutil.Clone
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/util/protoutil/clone.go:79
| github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc.newBuilder
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go:88
| github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc.NewBuilder
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go:50
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descbuilder/desc_builder.go:34
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.build
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:195
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:162
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.catalogQuerier.query
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go:129
| github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/internal/catkv/descriptors.go:39
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/kv_descriptors.go:267
| github.com/cockroachdb/cockroach/pkg/sql/catalog/descs.(*Collection).GetAllDescriptors
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/descs/collection.go:284
| github.com/cockroachdb/cockroach/pkg/sql.glob..func75.1
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/crdb_internal.go:426
| github.com/cockroachdb/cockroach/pkg/sql.setupGenerator.func3
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/sql/virtual_table.go:127
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| /ws/gc/cockroach/cache/gopath/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:494
| runtime.goexit
| /opt/ooce/go-1.17/src/runtime/asm_amd64.s:1581
Wraps: (2) runtime: allocation size out of range
Error types: (1) *withstack.withStack (2) runtime.plainError
-- report composition:
runtime.plainError
panic.go:1038: *withstack.withStack (top exception)

Stacktrace (expand for inline code snippets):

cockroach/pkg/util/protoutil/clone.go

Lines 78 to 80 in e438c2f

    
           	} 
        
           	return proto.Clone(pb).(Message) 
        
           }

in pkg/util/protoutil.Clone

cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go

Lines 87 to 89 in e438c2f

    
           return &tableDescriptorBuilder{ 
        
           	original:             protoutil.Clone(desc).(*descpb.TableDescriptor), 
        
           	isUncommittedVersion: isUncommittedVersion,

in pkg/sql/catalog/tabledesc.newBuilder

cockroach/pkg/sql/catalog/tabledesc/table_desc_builder.go

Lines 49 to 51 in e438c2f

    
           func NewBuilder(desc *descpb.TableDescriptor) TableDescriptorBuilder { 
        
           	return newBuilder(desc, false, /* isUncommittedVersion */ 
        
           		catalog.PostDeserializationChanges{})

in pkg/sql/catalog/tabledesc.NewBuilder

cockroach/pkg/sql/catalog/descbuilder/desc_builder.go

Lines 33 to 35 in e438c2f

    
           case table != nil: 
        
           	return tabledesc.NewBuilder(table) 
        
           case database != nil:

in pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 194 to 196 in e438c2f

    
           	} 
        
           	b = descbuilder.NewBuilderWithMVCCTimestamp(&descProto, rowValue.Timestamp) 
        
           }

in pkg/sql/catalog/internal/catkv.build

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 161 to 163 in e438c2f

    
           id := descpb.ID(u32ID) 
        
           desc, err := build(cq.expectedType, id, row.Value, cq.isRequired) 
        
           if err != nil {

in pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow

cockroach/pkg/sql/catalog/internal/catkv/catalog_query.go

Lines 128 to 130 in e438c2f

    
           case keys.DescriptorTableID: 
        
           	err = cq.processDescriptorResultRow(row, cb) 
        
           default:

in pkg/sql/catalog/internal/catkv.catalogQuerier.query

cockroach/pkg/sql/catalog/internal/catkv/descriptors.go

Lines 38 to 40 in e438c2f

    
           log.Eventf(ctx, "fetching all descriptors and namespace entries") 
        
           return cq.query(ctx, txn, func(codec keys.SQLCodec, b *kv.Batch) { 
        
           	b.Header.MaxSpanRequestKeys = 0

in pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated

cockroach/pkg/sql/catalog/descs/kv_descriptors.go

Lines 266 to 268 in e438c2f

    
           if kd.allDescriptors.isUnset() { 
        
           	c, err := catkv.GetCatalogUnvalidated(ctx, kd.codec, txn) 
        
           	if err != nil {

in pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors

cockroach/pkg/sql/catalog/descs/collection.go

Lines 283 to 285 in e438c2f

    
           func (tc *Collection) GetAllDescriptors(ctx context.Context, txn *kv.Txn) (nstree.Catalog, error) { 
        
           	return tc.kv.getAllDescriptors(ctx, txn, tc.version) 
        
           }

in pkg/sql/catalog/descs.(*Collection).GetAllDescriptors

cockroach/pkg/sql/crdb_internal.go

Lines 425 to 427 in e438c2f

    
           worker := func(ctx context.Context, pusher rowPusher) error { 
        
           	all, err := p.Descriptors().GetAllDescriptors(ctx, p.txn) 
        
           	if err != nil {

in pkg/sql.glob..func75.1

cockroach/pkg/sql/virtual_table.go

Lines 126 to 128 in e438c2f

    
           } 
        
           err := worker(ctx, funcRowPusher(addRow)) 
        
           // If the query was canceled, next() will already return a

in pkg/sql.setupGenerator.func3

cockroach/pkg/util/stop/stopper.go

Lines 493 to 495 in e438c2f

in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
/opt/ooce/go-1.17/src/runtime/asm_amd64.s#L1580-L1582 in runtime.goexit

/opt/ooce/go-1.17/src/runtime/panic.go in runtime.gopanic at line 1038
/opt/ooce/go-1.17/src/runtime/malloc.go in runtime.newarray at line 1254
/opt/ooce/go-1.17/src/runtime/malloc.go in reflect.unsafe_NewArray at line 1261
/opt/ooce/go-1.17/src/reflect/value.go in reflect.MakeSlice at line 2657
/opt/ooce/go-1.17/src/reflect/value.go in reflect.grow at line 2394
/opt/ooce/go-1.17/src/reflect/value.go in reflect.Append at line 2403
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*mergeInfo).computeMergeInfo.func27 at line 542
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*mergeInfo).merge at line 139
vendor/github.com/gogo/protobuf/proto/table_merge.go in github.com/gogo/protobuf/proto.(*InternalMessageInfo).Merge at line 50
pkg/sql/catalog/descpb/structured.pb.go in pkg/sql/catalog/descpb.(*TableDescriptor).XXX_Merge at line 2080
vendor/github.com/gogo/protobuf/proto/clone.go in github.com/gogo/protobuf/proto.Merge at line 95
vendor/github.com/gogo/protobuf/proto/clone.go in github.com/gogo/protobuf/proto.Clone at line 52
pkg/util/protoutil/clone.go in pkg/util/protoutil.Clone at line 79
pkg/sql/catalog/tabledesc/table_desc_builder.go in pkg/sql/catalog/tabledesc.newBuilder at line 88
pkg/sql/catalog/tabledesc/table_desc_builder.go in pkg/sql/catalog/tabledesc.NewBuilder at line 50
pkg/sql/catalog/descbuilder/desc_builder.go in pkg/sql/catalog/descbuilder.NewBuilderWithMVCCTimestamp at line 34
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.build at line 195
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuerier.processDescriptorResultRow at line 162
pkg/sql/catalog/internal/catkv/catalog_query.go in pkg/sql/catalog/internal/catkv.catalogQuerier.query at line 129
pkg/sql/catalog/internal/catkv/descriptors.go in pkg/sql/catalog/internal/catkv.GetCatalogUnvalidated at line 39
pkg/sql/catalog/descs/kv_descriptors.go in pkg/sql/catalog/descs.(*kvDescriptors).getAllDescriptors at line 267
pkg/sql/catalog/descs/collection.go in pkg/sql/catalog/descs.(*Collection).GetAllDescriptors at line 284
pkg/sql/crdb_internal.go in pkg/sql.glob..func75.1 at line 426
pkg/sql/virtual_table.go in pkg/sql.setupGenerator.func3 at line 127
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 494
/opt/ooce/go-1.17/src/runtime/asm_amd64.s in runtime.goexit at line 1581

Tag	Value
Cockroach Release	`v22.1.9-dirty`
Cockroach SHA:	`e438c2f`
Platform	illumos amd64
Distribution	OSS
Environment	development
Command	start-single-node
Go Version	``
# of CPUs
# of Goroutines

Jira issue: CRDB-22386

The text was updated successfully, but these errors were encountered:

yuzefovich · 2022-12-21T05:47:51Z

pretty sure this was during oxidecomputer/omicron#1146

cockroach-teamcity added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. labels Dec 13, 2022

yuzefovich closed this as completed Dec 21, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

cockroach-teamcity commented Dec 13, 2022 •

edited by cockroach-jira-scripts

Loading

yuzefovich commented Dec 21, 2022

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

sentry: panic.go:1038: runtime: allocation size out of range (1) attached stack trace -- stack trace: | runtime.gopanic | /opt/ooce/go-1.17/src/runtime/panic.go:1038 | runtime.newarray | /opt/ooce... #93539

Comments

cockroach-teamcity commented Dec 13, 2022 • edited by cockroach-jira-scripts Loading

yuzefovich commented Dec 21, 2022

cockroach-teamcity commented Dec 13, 2022 •

edited by cockroach-jira-scripts

Loading