天翼云盘 开启 家庭云转移 文件没有被删除

[zanjie1999]

Please make sure of the following things

• I have read the documentation.
  我已经阅读了文档。

• I'm sure there are no duplicate issues or discussions.
  我确定没有重复的issue或讨论。

• I'm sure it's due to AList and not something else(such as Network ,Dependencies or Operational).
  我确定是AList的问题，而不是其他原因（例如网络，依赖或操作）。

• I'm sure this issue is not fixed in the latest version.
  我确定这个问题在最新版本中没有被修复。

AList Version / AList 版本

v3.42.0

Driver used / 使用的存储驱动

189CloudPC

Describe the bug / 问题描述

使用群辉的cloudsync连接alist的webdav进行备份
在开启家庭云转移后，进行大量上传后发现家庭云空间中有越来越多的文件没有被删除
并且在控制台找到了

cleanFamilyTransferFolderError:res_code: InvalidArgument ,res_msg: Argument invalid

的错误

另外最近多次ip被封禁，找客服核实说ip被检测到正在攻击服务器，一天最多上传700g左右就 会封禁，应该跟这个没关系

Reproduction / 复现链接

无

Config / 配置

其中config.json保持默认

Logs / 日志

在日志中寻找到了一些

failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed get dir: failed get parent list: failed to list objs

等的错误，其中展示的这些文件在cloudsync的日志中多次上传失败，重启整个alist可以解决这个问题

[zanjie1999]

发现新问题，使用家庭云转移，文件可能出现有多余的括号数字时间的问题，例如004.jpg会变成004(20250206202955).jpg

上传的文件中，有多个文件夹中有相同的文件名的文件（因为是电子书，那是页码）
通过用(20250206搜索，发现有非常非常多

猜测是因为“家庭云转移”自动上传到家庭云的时候目录有重名文件，但是他没覆盖，直接自动修改了名字

[zanjie1999]

另外，天翼云盘似乎不能上传文件名前面有空格的文件，而网易云音乐十分擅长生成这种文件😥，导致一直重复上传那些文件

[foxxorcat]

你试试 #7958 这个提交能不能改善。

1.被认为是攻击是因为之前的转存没法用缓存，每次都要重新拉取目录，现在这个应该没问题了。
2.空格名文件暂时没太好的方法，毕竟天翼云盘官方就不支持，只能上传前手动重命名
3.没法删除的问题应该也解决了，这个不好处理删除接口就是有概率失败

[zanjie1999]

尝试了一下，在开启家庭云转移的情况下(不开正常)，如果上传已存在的文件（文件编辑了，上传新的版本，覆盖旧文件）会出错，可能是因为文件已存在，导致无法重命名，可能需要先判断是否已存在，删除旧文件

ERRO[2025-02-07 18:07:00] failed put /天翼云盘/OwO/资料/下载/TicwatchPro/2019-04-02--01-10-58_OWDM180807005国际版8.0随便设置: res_code: FileAlreadyExists ,res_msg
: renameFile() - operId = 143304878, srcUserId=143304878, parentId = 323761177904147890, newFileName = data.info, exist.
github.com/alist-org/alist/v3/internal/op.Put
        /home/runner/work/alist/alist/internal/op/fs.go:587
github.com/alist-org/alist/v3/internal/fs.putDirectly
        /home/runner/work/alist/alist/internal/fs/put.go:80
github.com/alist-org/alist/v3/internal/fs.PutDirectly
        /home/runner/work/alist/alist/internal/fs/fs.go:98
github.com/alist-org/alist/v3/server/webdav.(*Handler).handlePut
        /home/runner/work/alist/alist/server/webdav/webdav.go:345
github.com/alist-org/alist/v3/server/webdav.(*Handler).ServeHTTP
        /home/runner/work/alist/alist/server/webdav/webdav.go:66
github.com/alist-org/alist/v3/server.ServeWebDAV
        /home/runner/work/alist/alist/server/webdav.go:45
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/alist-org/alist/v3/server.WebDAVAuth
        /home/runner/work/alist/alist/server/webdav.go:127
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/alist-org/alist/v3/server/middlewares.StoragesLoaded
        /home/runner/work/alist/alist/server/middlewares/check.go:14
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:102
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.LoggerWithConfig.func1
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/logger.go:249
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:633
github.com/gin-gonic/gin.(*Engine).ServeHTTP
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:589
net/http.serverHandler.ServeHTTP
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/net/http/server.go:3210
net/http.(*conn).serve
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/net/http/server.go:2092
runtime.goexit
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1700

[foxxorcat]

修改了，你试试。接口请求太多没办法做到原子性，上传失败的文件并且删除也失败的只能通过后缀.transfer找到手动删除

[zanjie1999]

在测试使用使用 上一版进行了3分钟的图片文件上传后，似乎因为某个接口的频繁调用导致触发请求频率过高，刚测试了一下当前的版本也出现了这个问题
（重新拨号获取了新的ipv6在进行测试的，不然连web端的搜索操作也会有类似的返回）

ERRO[2025-02-07 22:01:49] PUT /dav/天翼云盘/OwO/backup/DSC06168.JPG res_code: AccessDenyOfHighFrequency ,res_msg: Access Denied by High Frequency
github.com/alist-org/alist/v3/internal/op.Put
        /home/runner/work/alist/alist/internal/op/fs.go:587
github.com/alist-org/alist/v3/internal/fs.putDirectly
        /home/runner/work/alist/alist/internal/fs/put.go:80
github.com/alist-org/alist/v3/internal/fs.PutDirectly
        /home/runner/work/alist/alist/internal/fs/fs.go:98
github.com/alist-org/alist/v3/server/webdav.(*Handler).handlePut
        /home/runner/work/alist/alist/server/webdav/webdav.go:345
github.com/alist-org/alist/v3/server/webdav.(*Handler).ServeHTTP
        /home/runner/work/alist/alist/server/webdav/webdav.go:66
github.com/alist-org/alist/v3/server.ServeWebDAV
        /home/runner/work/alist/alist/server/webdav.go:45
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/alist-org/alist/v3/server.WebDAVAuth
        /home/runner/work/alist/alist/server/webdav.go:127
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/alist-org/alist/v3/server/middlewares.StoragesLoaded
        /home/runner/work/alist/alist/server/middlewares/check.go:14
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:102
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.LoggerWithConfig.func1
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/logger.go:249
github.com/gin-gonic/gin.(*Context).Next
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:185
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:633
github.com/gin-gonic/gin.(*Engine).ServeHTTP
        /home/runner/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:589
net/http.serverHandler.ServeHTTP
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/net/http/server.go:3210
net/http.(*conn).serve
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/net/http/server.go:2092
runtime.goexit
        /home/runner/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1700

[foxxorcat]

那就是搜索接口有频率限制，明天在改