awk - Data partitioning by columns -

-

i have big matrix of 50 rows , 1.5m columns. these 1.5m columns, first 2 headers.

i trying divide data columns small pieces. example each small set 50 lines , 100 columns. each small data must have first 2 columns mentioned above headers.

i tried

awk '{print $1"\t"$2"\t"}' test | cut -f 3-10 awk '{print $1"\t"$2"\t"}' test | cut -f 11-20 ...

or

cut -f 1-2 | cut -f 3-10 test cut -f 1-2 | cut -f 11-20 test ...

but none of above working.

is there efficient way of doing this?

one way . don't know if (awk) can handle such big number of columns, give try. uses modulus operator cut line each specific number of columns.

awk '{         ## print header of first line.         printf "%s%s%s%s", $1, fs, $2, fs         ## count number of columns printed, 0 100.         count = 0         ## traverse every columns first 2 keys.         ( = 3; <= nf; i++ ) {             ## print header again when counted 100 columns.             if ( count != 0 && count % 100 == 0 ) {                 printf "%s%s%s%s%s", ors, $1, fs, $2, fs             }             ## print current column , count it.             printf "%s%s", $i, fs             ++count         }         ## separator between splits.         print ors     } ' infile

i've tested 2 lines , 4 columns instead of 100. here test file:

key1 key2 1 2 3 4 5 6 7 8 9 ten key1 key2 one2 two2 three2 four2 five2 six2 seven2 eight2 nine2 ten2

and results in:

key1 key2 1 2 3 4  key1 key2 5 6 7 8  key1 key2 9 ten   key1 key2 one2 two2 three2 four2  key1 key2 five2 six2 seven2 eight2  key1 key2 nine2 ten2

Comments

Post a Comment

Popular posts from this blog

c# - must be a non-abstract type with a public parameterless constructor in redis -

-
when save object, got below error must non-abstract type public parameterless constructor in order use parameter 't' in generic type or method 'servicestack.redis.redisclient.store<t>(t) redisclass.getinstnace().store(msg); // error here redisclass.getinstnace().save(); as third party's class, can not edit how save object? could create wrapper around third party object call constructor, store wrapper? e.g. public class mywrapper { public thirdpartyobject thirdpartyinstance { get; set; } public mywrapper() { thirdpartyinstance = new thirdpartyobject("constructors"); } }
Read more

c# - ReportViewer control - axd url -

-
i've embedded microsoft.reporting.webforms.reportviewer control in aspx. site works on mysite.com. when try exmple export report, there new black window opened address mysite.com/reserved.reportviewerwebcontrol.axd... it's working fine. but.. pass axd via proxy. mean, i'd force export use url myproxy.mysite.com/reserved.reportviewerwebcontrol.axd... redirect request mysite.com/reserved.reportviewerwebcontrol.axd... i've noticed, link build within js (that inlcuded in axd): exportreport: function(format) { if (this.exporturlbase == null) return false; window.open(this.exporturlbase + encodeuricomponent(format), "_blank"); return true; }, the url axd stored in exporturlbase . how can change proxy serwer url? it possible modify exporturlbase field in javascript. report stored in placeholder somewhere on page, once found can create call _getinternalviewer() function on gain access exporturlbase. have @ following code: ...
Read more

time series - R growth rate calculation week over week on daily timeseries data -

-
i'm trying calculate w/w growth rates entirely in r. use excel, or preprocess ruby, that's not point. data.frame example date gpv type 1 2013-04-01 12900 office 2 2013-04-02 16232 office 3 2013-04-03 10035 office i want factored 'type' , need wrap date type column weeks. , calculate week on week growth. i think need ddply group week - custom function determines if date in given week or not? then, after that, use diff , find growth b/w weeks divided previous week. then i'll plot week/week growths, or use data.frame export it. this closed had same useful ideas. update: answer ggplot: all same below, use instead of plot ggplot(data.frame(week=seq(length(gr)), gr), aes(x=week,y=gr*100)) + geom_point() + geom_smooth(method='loess') + coord_cartesian(xlim = c(.95, 10.05)) + scale_x_discrete() + ggtitle('week on week growth rate, apr 1') + ylab('growth rate %') (old, correct answer using plot) w...
Read more