Solving bug where the ContentLength might come as -1 (unknown) random…

…ly and cause a panic.

README.md

@@ -67,13 +67,13 @@ For instance, if you just want to find publicly exposed containers using large l
 
 If, on the other hand, you want to test a small list of very popular container names against a large set of storage accounts, you might want to try `-invertsearch=true` with `-maxpages=0`, in order to see the public accounts for each container name instead of the container names for each storage account.
 
-You may also want to try changing `goroutines`, `-timeout` and `-maxidleconns`, `-maxidleconnsperhost` and `-maxconnsperhost` and `-skipssl` in order to best use your bandwidth and find results faster.
+You may also want to try changing `-goroutines`, `-timeout` and `-maxidleconns`, `-maxidleconnsperhost` and `-maxconnsperhost` and `-skipssl` in order to best use your bandwidth and find results faster.
 
 Experiment with the flags to find what works best for you ;-)
 
 ## Example
 
-TODO: Put example here
+
 
 # Contributing
 Contributions are welcome by [opening an issue](https://github.com/Macmod/goblob/issues/new) or by [submitting a pull request](https://github.com/Macmod/goblob/pulls).

core/scanner.go

@@ -118,7 +118,14 @@ func (cs *ContainerScanner) ScanContainer(account string, containerName string,
 					statusCode := resp.StatusCode
 					defer resp.Body.Close()
 
-					resBuf := make([]byte, resp.ContentLength)
+					var preallocBufferSize int64
+					if resp.ContentLength >= 0 {
+						preallocBufferSize = resp.ContentLength
+					} else {
+						preallocBufferSize = 128
+					}
+
+					var resBuf = make([]byte, preallocBufferSize)
 					resBuf, err = io.ReadAll(resp.Body)
 
 					if err != nil {