快速将大脚本分拆成多份并发执行脚本 巧用命令 更快更爽

 Yuema约吗?一起学技术,一起成长!学海无涯 高人带路系列

程序的世界,就是有坑的地方!分享踩坑的心得与体验!每天分享一点点!

关注公众号,进入学海无涯,高人带路模式!!​split​再难,有人带路,轻松搞定

命令比较晦涩

split -l 2 1.txt -d -a 4 data_&&ls|grep data_|xargs -n1 -i{} mv {} {}.sh

$ split --helpUsage: split [OPTION]... [FILE [PREFIX]]Output pieces of FILE to PREFIXaa, PREFIXab, ...;default size is 1000 lines, and default PREFIX is 'x'.With no FILE, or when FILE is -, read standard input.Mandatory arguments to long options are mandatory for short options too.  -a, --suffix-length=N   generate suffixes of length N (default 2)      --additional-suffix=SUFFIX  append an additional SUFFIX to file names  -b, --bytes=SIZE        put SIZE bytes per output file  -C, --line-bytes=SIZE   put at most SIZE bytes of records per output file  -d                      use numeric suffixes starting at 0, not alphabetic      --numeric-suffixes[=FROM]  same as -d, but allow setting the start value  -e, --elide-empty-files  do not generate empty output files with '-n'      --filter=COMMAND    write to shell COMMAND; file name is $FILE  -l, --lines=NUMBER      put NUMBER lines/records per output file  -n, --number=CHUNKS     generate CHUNKS output files; see explanation below  -t, --separator=SEP     use SEP instead of newline as the record separator;                            '\0' (zero) specifies the NUL character  -u, --unbuffered        immediately copy input to output with '-n r/...'      --verbose           print a diagnostic just before each                            output file is opened      --help     display this help and exit      --version  output version information and exitThe SIZE argument is an integer and optional unit (example: 10K is 10*1024).Units are K,M,G,T,P,E,Z,Y (powers of 1024) or KB,MB,... (powers of 1000).CHUNKS may be:  N       split into N files based on size of input  K/N     output Kth of N to stdout  l/N     split into N files without splitting lines/records  l/K/N   output Kth of N to stdout without splitting lines/records  r/N     like 'l' but use round robin distribution  r/K/N   likewise but only output Kth of N to stdoutGNU coreutils online help: <http://www.gnu.org/software/coreutils/>Report split translation bugs to <http://translationproject.org/team/>Full documentation at: <http://www.gnu.org/software/coreutils/split>or available locally via: info '(coreutils) split invocation'
不要造低级的轮子,这个轮子一点都不低级,如果自己去写代码的话,也好实现,不过,有现成的工具就用上吧,而且直接使用git bash就能完成脚本拆分。
这已经实现了昨天所期望的自动拆分脚本,而脚本生成,执行进度监控并没有实现,不过,感觉已经比较爽了。一个适度的平衡点吧!split -l 2 1.txt -d -a 4 data_&&ls|grep data_|xargs -n1 -i{} mv {} {}.sh 这轮子顶很多很多行代码了,如果写个程序进行大文本拆成多份文本,想想得多少行,这么一行命令就按定

作者:钟代麒

出处:http://www.jishudao.com/
版权归作者所有,转载请注明出处

此条目发表在未分类分类目录。将固定链接加入收藏夹。

发表评论

邮箱地址不会被公开。 必填项已用*标注