How to count the number of bytes in a file, grouping the same bytes?count lines in a fileHow do you write specific bytes to a file?How could I use Bash to find 2 bytes in a binary file, increase their values, and replace?How do you get a count of all file extensions on a hard drive using the gnu+linux terminal?Writing an unlimited number of defined values into a fileCount the Number of Words that Start with each Letter in a FileHow do I trim bytes from the beginning and end of a file?How to get a count of specific process using ps command and then sort nd count it user wiseHow to improve the specific columns count AWKHow to print the count of pattern at each line?

Where to connect the fuse and why?

Does friction always oppose motion?

Fast method to cut/shred glue stick into small pieces

What happens if a caster is surprised while casting a spell with a long casting time?

Why didn't Caesar move against Sextus Pompey immediately after Munda?

What are the children of two Muggle-borns called?

Subset of knight's move in chess.

Two palindromes are not enough

I agreed to cancel a long-planned vacation (with travel costs) due to project deadlines, but now the timeline has all changed again

Is this house-rule removing the increased effect of cantrips at higher character levels balanced?

Customs and immigration on a USA-UK-Sweden flight itinerary

Correct use of the the idiom 'Гнать/Катить бочку'

Why should I allow multiple IPs on a website for a single session?

Is my guitar action too high or is the bridge too high?

Checkmate in 1 on a Tangled Board

How soon after takeoff can you recline your airplane seat?

How did they film the Invisible Man being invisible in 1933?

"I am [the / an] owner of a bookstore"?

Avoiding repetition when using the "snprintf idiom" to write text

Tricolour nonogram

Does "boire un jus" tend to mean "coffee" or "juice of fruit"?

Active wildlife outside the window- Good or Bad for Cat psychology?

Equatorial oceanic river caused by tides

Sort a list of lists by increasing order of elements



How to count the number of bytes in a file, grouping the same bytes?


count lines in a fileHow do you write specific bytes to a file?How could I use Bash to find 2 bytes in a binary file, increase their values, and replace?How do you get a count of all file extensions on a hard drive using the gnu+linux terminal?Writing an unlimited number of defined values into a fileCount the Number of Words that Start with each Letter in a FileHow do I trim bytes from the beginning and end of a file?How to get a count of specific process using ps command and then sort nd count it user wiseHow to improve the specific columns count AWKHow to print the count of pattern at each line?













2















Example: I have the file "mybinaryfile", and the contents in hex are:



A0 01 00 FF 77 01 77 01 A0


I need to know how many A0 bytes there are in this file, how many 01, and so on. The result could be:



A0: 2
01: 3
00: 0
FF: 0
77: 2


Is there some way to make this count directly in shell or do I need to write a program in whatever language to do this specific task?






linux command-line files binary byte







share|improve this question
























  • Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

    – Jesse_b
    8 hours ago
















2















Example: I have the file "mybinaryfile", and the contents in hex are:



A0 01 00 FF 77 01 77 01 A0


I need to know how many A0 bytes there are in this file, how many 01, and so on. The result could be:



A0: 2
01: 3
00: 0
FF: 0
77: 2


Is there some way to make this count directly in shell or do I need to write a program in whatever language to do this specific task?






linux command-line files binary byte







share|improve this question
























  • Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

    – Jesse_b
    8 hours ago














2












2








2








Example: I have the file "mybinaryfile", and the contents in hex are:



A0 01 00 FF 77 01 77 01 A0


I need to know how many A0 bytes there are in this file, how many 01, and so on. The result could be:



A0: 2
01: 3
00: 0
FF: 0
77: 2


Is there some way to make this count directly in shell or do I need to write a program in whatever language to do this specific task?






linux command-line files binary byte







share|improve this question
















Example: I have the file "mybinaryfile", and the contents in hex are:



A0 01 00 FF 77 01 77 01 A0


I need to know how many A0 bytes there are in this file, how many 01, and so on. The result could be:



A0: 2
01: 3
00: 0
FF: 0
77: 2


Is there some way to make this count directly in shell or do I need to write a program in whatever language to do this specific task?






linux command-line files binary byte




linux command-line files binary byte






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited 7 hours ago









Stephen Kitt

193k26 gold badges460 silver badges530 bronze badges




193k26 gold badges460 silver badges530 bronze badges










asked 8 hours ago









LawrenceLawrence

255 bronze badges




255 bronze badges












  • Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

    – Jesse_b
    8 hours ago


















  • Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

    – Jesse_b
    8 hours ago

















Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

– Jesse_b
8 hours ago






Does this file have multiple lines? Also why do you have 0 for 00 and FF when there is one of each?

– Jesse_b
8 hours ago











2 Answers
2






active

oldest

votes


















9














This uses od to show one hex value per line, then sorts and counts:



od -t x1 -w1 -v -An mybinaryfile | sort | uniq -c


(-w1 is an extension, it’s not mandated by POSIX.)






share|improve this answer
































    2














    Using Perl to unpack the slurped file to a byte array and then use a hash to count unique bytes:



    printf 'xA0x01x00xFFx77x01x77x01xA0' | 
     perl -0777 -nE '
     @bytes = unpack("C*",$_) 
     } sort 
     $counts$_++ for @bytes; 
     for $k (sort $a <=> $b keys %counts) 
     printf "%02X: %dn", $k, $counts$k
     
     '
    00: 1
    01: 3
    77: 2
    A0: 2
    FF: 1


    If a sufficiently recent version of List::MoreUtils is available, you may be able to simplify the counting by using its frequency function.






    share 









    2












    2








    2







    Using Perl to unpack the slurped file to a byte array and then use a hash to count unique bytes:



    printf 'xA0x01x00xFFx77x01x77x01xA0' 
     perl -0777 -nE '
     @bytes = unpack("C*",$_) 
     { 
     $counts$_++ for @bytes; 
     for $k (sort $a <=> $b keys %counts) 
     printf "%02X: %dn", $k, $counts$k
     
     '
    00: 1
    01: 3
    77: 2
    A0: 2
    FF: 1


    If a sufficiently recent version of List::MoreUtils is available, you may be able to simplify the counting by using its frequency function.







    share|improve this answer














    share|improve this answer



    share|improve this answer








    edited 6 hours ago









    Stéphane Chazelas

    323k57 gold badges625 silver badges992 bronze badges




    323k57 gold badges625 silver badges992 bronze badges










    answered 7 hours ago









    steeldriversteeldriver

    40.3k4 gold badges55 silver badges93 bronze badges




    40.3k4 gold badges55 silver badges93 bronze badges



























        draft saved

        draft discarded
















































        Thanks for contributing an answer to Unix & Linux Stack Exchange!


        • Please be sure to answer the question. Provide details and share your research!

        But avoid …


        • Asking for help, clarification, or responding to other answers.

        • Making statements based on opinion; back them up with references or personal experience.

        To learn more, see our tips on writing great answers.




        draft saved


        draft discarded














        StackExchange.ready(
        function ()
        StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f527521%2fhow-to-count-the-number-of-bytes-in-a-file-grouping-the-same-bytes%23new-answer', 'question_page');

        );

        Post as a guest















        Required, but never shown





















































        Required, but never shown














        Required, but never shown












        Required, but never shown







        Required, but never shown

































        Required, but never shown














        Required, but never shown












        Required, but never shown







        Required, but never shown







        -

        Popular posts from this blog

        Canceling a color specificationRandomly assigning color to Graphics3D objects?Default color for Filling in Mathematica 9Coloring specific elements of sets with a prime modified order in an array plotHow to pick a color differing significantly from the colors already in a given color list?Detection of the text colorColor numbers based on their valueCan color schemes for use with ColorData include opacity specification?My dynamic color schemes

        Image
        Would it be easier to colonise a living world or a dead world? Postal services in Italy - Poste Italiane vs. Friendpost vs. GPS What is /dev/null and why can't I use hx on it? Why are engines with carburetors hard to start in cold weather? How to make a gift without seeming creepy? Without exposing his identity, did Roy help his parents with money so that they can afford to stay in their home? Does the Creighton Method of Natural Family Planning have a failure rate of 3.2% or less? How do I break the broom in Untitled Goose Game? Had there been instances of national states banning harmful imports before the mid-19th C Opium Wars? D&D Monsters and Copyright Is sleeping on the groud in cold weather better than on an air mattress? Transiting through Switzerland by coach with lots of cash quadratic equations on 2 by 2 matrices Always Lubricate Skewers? I pay for a service, but I miss the broadcast Iron-age tools, is there a way to extract heavy metals ...
        Read more

        Invision Community Contents History See also References External links Navigation menuProprietaryinvisioncommunity.comIPS Community ForumsIPS Community Forumsthis blog entry"License Changes, IP.Board 3.4, and the Future""Interview -- Matt Mecham of Ibforums""CEO Invision Power Board, Matt Mecham Is a Liar, Thief!"IPB License Explanation 1.3, 1.3.1, 2.0, and 2.1ArchivedSecurity Fixes, Updates And Enhancements For IPB 1.3.1Archived"New Demo Accounts - Invision Power Services"the original"New Default Skin"the original"Invision Power Board 3.0.0 and Applications Released"the original"Archived copy"the original"Perpetual licenses being done away with""Release Notes - Invision Power Services""Introducing: IPS Community Suite 4!"Invision Community Release Notes

        Image
        Internet forum softwarePHP software Internet communityPHPMySQLdatabase management systemInternet forumCharles WarnerMatt MechamJarvis Entertainment GroupIkonboardInvisionFreeAjaxIPS Community ForumsIPS Community Forumsthis blog entry Invision Community From Wikipedia, the free encyclopedia Jump to navigation Jump to search Invision Community Developer(s) Invision Power Services Stable release 4.4.6 / August 19, 2019 ; 34 days ago  ( 2019-08-19 ) Platform PHP / MySQL Type Forum software License Proprietary Website invisioncommunity.com Invision Community (previously known as IPS Community Suite ) is primarily an Internet community software produced by Invision Power Services, Inc. It is written in PHP and uses MySQL as a database management system. Invision Power Services sell applications that each can be bought and installed separately in addition to the Suite, the most widely known being the Internet forum software Invision Power Boar...
        Read more

        199年 目錄 大件事 到箇年出世嗰人 到箇年死嗰人 節慶、風俗習慣 導覽選單

        Image
        199年 平年 199年 出自維基百科 跳至導覽 跳至搜尋 世紀： 1世紀 2世紀 3世紀 年代： 160年代 170年代 180年代 190年代 200年代 210年代 220年代 年： 194年 195年 196年 197年 198年 199年 200年 201年 202年 203年 204年 干支年： 己卯年 （ 兔年 ） 年號： 199年 係平年。 目錄 1 大件事 2 到箇年出世嗰人 3 到箇年死嗰人 4 節慶、風俗習慣 大件事 199...
        Read more