Linux binary to ascii

Конвертирование файлов в кодировку UTF-8 в Linux

Оригинал: How to Convert Files to UTF-8 Encoding in Linux
Автор: Aaron Kili
Дата публикации: 2 ноября 2016 года
Перевод: А. Кривошей
Дата перевода: ноябрь 2017 г.

В этом руководстве мы рассмотрим кодировки символов и разберем несколько примеров преобразования файлов из одной кодировки в другую с помощью утилиты командной строки. Затем мы покажем, как преобразовать файлы в Linux из любой кодировки (charset) в UTF-8.

Как вы, наверное, уже знаете, компьютер не понимает и не хранит информацию в виде букв, цифр или чего-либо еще. Он работает только с битами. Бит имеет только два возможных значения — 0 или 1, true или false, да или нет. Все остальное кодируется последовательностями битов.

Простыми словами, кодировка символов — это способ кодировки различных символов определенными последовательностями нулей и единиц. Когда мы вводим текст и сохраняем его в файл, слова и предложения, которые мы набираем, состоят из разных символов, а символы преобразуются в биты с помощью кодировки.

Существуют различные схемы кодирования, такие как ASCII, ANSI, Unicode и другие. Ниже приведен пример кодировки ASCII.

В Linux для преобразования текста из одной кодировки в другую используется утилита командной строки iconv.
Вы можете проверить кодировку файла с помощью команды file, используя флаг -i или -mime, который печатает строку типа mime, как в приведенных ниже примерах:

Синтаксис команды iconv следующий:

Где -f или —from-code задает входную кодировку, а -t или —to-encoding задает конечную кодировку.

Для того, чтобы вывести список всех доступных опций, введите:

Конвертирование файлов из UTF-8 в ASCII

Далее мы научимся конвертировать текст из одной кодировки в другую. Приведенная ниже команда преобразует текст из ISO-8859-1 в кодировку UTF-8.

Рассмотрим файл input.file, который содержит следующие символы:

(Прим: вы увидите эти символы на снимке ниже)

Начнем с проверки кодировки файла, затем просмотрим его содержимое. Мы можем преобразовать все символы в кодировку ASCII.
После запуска команды iconv мы затем проверяем содержимое выходного файла и новую кодировку, как показано ниже.

Примечание. Если в команду добавлена строка //IGNORE, то символы, которые не могут быть преобразованы, и ошибка выводятся после преобразования.

Далее, если добавлена строка //TRANSLIT, как в приведенном выше примере (ASCII//TRANSLIT), преобразуемые символы при необходимости и по возможности транслитерируются. Это означает, что если символ не может быть представлен в целевой кодировке, его можно аппроксимировать одним или несколькими похожими символами.

Далее, любой символ, который не может быть транслитерирован и которого нет в целевой кодировке, заменяется в выводе вопросительным знаком (?).

Конвертирование нескольких файлов в кодировку UTF-8

Возвращаясь к основной теме нашей статьи, мы можем написать небольшой скрипт для преобразования нескольких или всех файлов в каталоге в кодировку UTF-8, под названием encoding.sh:

Сохраните этот файл и сделайте скрипт исполняемым. Запускайте его из той директории, где расположены ваши файлы.

Важное замечание. Вы также можете также использовать этот скрипт для преобразования нескольких файлов из одной заданной кодировки в другую (любую), просто меняйте со значения переменных FROM_ENCODING и TO_ENCODING, не забывая об имени выходного файла «$ . utf8.converted».

Для получения дополнительной информации почитайте руководство iconv:

Подводя итог этой статье, необходимо отметить, что понимание способов преобразования текста из одной кодировки в другую — это знания, необходимые каждому пользователю компьютера, а тем более программистам, когда дело касается работы с текстами.

Если вы хотите лучше понять проблему кодировок символов, прочитайте следующие статьи:

Источник

Delightly Linux

ascii2binary

📅 May 20, 2018
Do you need a program that will convert an ASCII code into a character?

How about converting a number represented as ASCII into its binary equivalent based upon the data type you specify?

Try ascii2binary. Available from the Ubuntu repository, ascii2binary can be used alone or in scripts to convert a decimal, octal, binary, or hexadecimal input into its ASCII character or convert a text file of numbers into a binary file of numbers.

Installation

This was tested using Linux Mint 18.3.

Also available using Synaptic.

Example Usage

By default, ascii2binary converts decimal values into ASCII characters. For the interactive mode, enter ascii2binary in a terminal and enter a code from 0 to 127 to see what happens. (It helps to have an ascii table open while doing this.)

ascii2binary in its default action.

As each decimal ASCII code was entered, its corresponding ASCII character was displayed on the next line. The next code must be entered on the same line as the character since Enter will exit the program.

For characters unable for display, such as 0 to 5 or 128 as shown, a unicode block or symbol will appear.

Hexadecimal Input

We can also enter codes in hexadecimal.

Spelling the word Hello! one character at a time using hex codes.

Binary Input

We can even enter ASCII values as binary.

Same Hello! entered as binary. Leading zeroes are optional.

Type Sizes

Another useful feature of ascii2binary is finding out the range of data types on a system.

How many bytes does an unsigned int consume on a given system? The -s option reveals. On this system, it is 4 bytes (32 bits) with a range of 0 to 4,294,967,295.

This information may vary with the given platform, 32-bit or 64-bit, and processor. These are the results on a 64-bit CPU running Linux Mint 18.3 64-bit. If you ever need to look up this information, ascii2binary is a quick tool.

For more information, have a look at man ascii2binary.

“Wait a minute! We have been converting to ASCII characters by entering ASCII values, but the program is titled ascii2binary. Why not enter text and convert it into binary?”

Despite the name, ascii2binary does not operate as we might expect at first glance. Documentation about ascii2binary is sparse aside from the official web page and the man page. We cannot enter a text string, such as Hello! and expect ascii2binary to convert it into a series of binary digits.

This is not how ascii2binary functions. Attempting to convert text into binary like this does not work.

“So, what does ascii2binary actually do?”

ascii2binary converts a textual representation of a number consisting of ASCII characters into its binary equivalent. For example, the decimal number 2,002 consist of ASCII number characters: 2, 0, 0, and 2. We can find 2 and 0 in an ASCII chart.

• The decimal number 9999 consists of four ASCII ‘9’ characters.
• 10,678 consists of five ASCII characters: 1, 0, 6, 7, 8, and a comma character.
• 9,999 consists of 9, 9, 9, 9, and a comma.
• 26 consists of the ASCII characters 2 and 6.
• …and so on for all numbers.

Notice that each number is represented by a sequence of ASCII number characters that represent that value. We can store the textual (ASCII) representation of a number in a text file or use it in a script or on the command line. In each case the number consists of ASCII number characters.

These numbers are ASCII characters, not binary. What if we want to convert a number that is spelled out using ASCII number characters into a binary value?

This is what ascii2binary is for. It will convert a number, such as 4,294,967,295, and convert it into its binary version, which is 0xFFFFFFFF (four bytes) as hexadecimal or 11111111 11111111 11111111 11111111 (32-bits) in binary.

Examples

Suppose we have a text file named number.txt that contains the decimal number 56. No other text is present since this will cause errors.

The -t option specifies the output type. We are converting from an ASCII representation of a number into its binary equivalent. The type must be large enough to store the value. If you are not certain what your system can support, run ascii2binary -s as we did before to view what types are supported on your system. The ui says, “Store the binary value as an unsigned integer.” (man ascii2binary shows what abbreviations to use for the various output types.)

The number 56 will fit in every data type, signed or unsigned, since it fits within seven bits.

The command above generates a binary output, so we store that result in the binary file named number.bin. This is a binary file, so we cannot use a text editor to view it. We must open it in a hex editor to view its contents. Here is what number.bin contains when viewed in the GHex hex editor.

56 (decimal) stored as an unsigned int in the binary file number.bin. An unsigned int requires four bytes to store a value. Since this is running on an Intel processor, the bytes are reversed and stored as little-endian in the file. So, 0x00000038 is stored as 38 00 00 00 as shown. This is normal. Notice that 56 appears in all data types within GHex. (56 decimal = 0x38)

Example Unsigned Long

Let’s see what happens if we use the same number.txt file containing 56 (ASCII decimal) but change the binary output to an unsigned long with -t ul.

Same value 56, but it now takes eight bytes to store it since the size of an unsigned long is eight bytes on this system, not four bytes. The little-endian rule still applies. Even though 56 is represented as 0x0000000000000038, it is stored as 0x3800000000000000 in the file. Always keep this in mind when dealing with Intel processors.

Example 9,098

Let’s try a number containing commas as a separator. The number.txt file has been changed to contain 9,098.

9,098 (ASCII decimal) converted to a signed integer in binary. Commas do not matter, and they do not appear in the binary output.

9,098 (decimal) is converted to 0x0000238A and stored as 0x8A230000 (little-endian, smallest byte first). Any commas in the number are ignored. This is another useful feature of ascii2binary: dealing with locale number separators.

Multiple Numbers

We can store multiple numbers in a text file as ASCII and convert them into binary. All numbers must be of the same data type, so pick a size that will hold the largest number in the text file.

Here is number.txt with four numbers.

Numbers with and without commas, Use whitespace to separate each number.

Since the largest number is 4,294,967,295, we must use at least an unsigned integer (four bytes stores 2^32 – 1). All numbers in the file (including smaller numbers) will be converted into an unsigned int data type.

All numbers are stored as a sequence of bytes, each four bytes in length and little-endian.

The highlighted byte marks the start of the second number, 888, represented as a sequence of four bytes. Remember, an Intel processor stores binary data as little-endian. Numbers are stored in binary in the same order that they appear in the text file.

• 99 -> 0x00000063 (hex) -> 0x63000000 (stored)
• 888 -> 0x00000378 (hex) -> 0x78030000 (stored)
• 9999 -> 0x0000270F (hex) -> 0x0F270000 (stored)
• 4,294,967,295 -> 0xFFFFFFFF (hex) -> 0xFFFFFFFF (stored)

“What good is this?”

Scripts and the command only deal with ASCII values that we can type from the keyboard. There are times when we need to evaluate raw binary values, but we must convert from ASCII into binary first. This is what ascii2binary is for.

More is possible with ascii2binary. For example, the ASCII numbers are not limited to decimal representations. We can input hex, octal, and binary as well, and those numbers will be converted into binary.

While not intuitive at first glance, ascii2binary is the kind of tool that you will wish existed and be glad it does exist for when you encounter a situation that requires it.

Источник

Binary to Ascii Text Converter

In order to use this binary to ascii text converter tool, type a binary value, i.e. 011110010110111101110101, to get «you» and push the convert button. You can convert up to 1024 binary characters to ascii text. Decode binary to ascii text readable format.

Binary System

The binary numeral system uses the number 2 as its base (radix). As a base-2 numeral system, it consists of only two numbers: 0 and 1.

While it has been applied in ancient Egypt, China and India for different purposes, the binary system has become the language of electronics and computers in the modern world. This is the most efficient system to detect an electric signal’s off (0) and on (1) state. It is also the basis for binary code that is used to compose data in computer-based machines. Even the digital text that you are reading right now consists of binary numbers.

Reading a binary number is easier than it looks: This is a positional system; therefore, every digit in a binary number is raised to the powers of 2, starting from the rightmost with 2 0 . In the binary system, each binary digit refers to 1 bit.

ASCII Text

ASCII (American Standard Code for Information Interchange) is one of the most common character encoding standards. Originally developed from telegraphic codes, ASCII is now widely used in electronic communication for conveying text.

As computers can only understand numbers, the ASCII code represents text (characters) with different numbers. This is how a computer ‘understands’ and shows text.

The original ASCII is based on 128 characters. These are the 26 letters of the English alphabet (both in lower and upper cases); numbers from 0 to 9; and various punctuation marks. In the ASCII code, each of these characters are assigned a decimal number from 0 to 127. For example, the ASCII representation of upper case A is 65 and the lower case a is 97.

Binary to String Conversion

The string for a given binary number will depend on the programming language. Theoretically you can invent your own alphabet and language, encode it in binary and produce strings.

How to Convert Binary to ASCII Text

Converting binary numbers to ASCII text shows how a computer understand words. While online converters make this conversion very easy, it can also be done manually.

To convert from ASCII to Binary, two things are needed:
1. An ASCII table, which shows the decimal codes for 128 symbols (10 digits, 26 letters of the English alphabet both in lower and upper case, a number of punctuation marks and commands );
2. In addition, you should also know how to convert binary numbers to decimal numbers.
Binary To Decimal Converter

Here is how to convert binary to ASCII text step by step:

• Step 1: Convert each of the binary numbers to their decimal equivalent.
• Step 2: Look up the decimal number from the ASCII table to figure out what letter or punctuation mark it is assigned to.
• Step 3: The letters acquired at the end show the ASCII text for the given binary number.

Binary to ASCII Text Conversion Examples

Example: 01110111 01101111 01110010 01100100

Step 1: Start by converting the binary numbers in groups of eight from the left to right. Using the subtraction method in reverse would render this binary to decimal conversion faster.

Step 2: Look up the decimal numbers 119, 111, 114 and 100 in the ASCII table. 119 is w, 111 is o, 114 is r and 100 is d.
Therefore, the ASCII text for the given binary number is word.

Also check the Binary Ascii Conversion Table how to convert binary to ascii text.

Recent Comments

great now i can build my own language on top of this thanks xqcL

yh it is really helpful buh i kinda have a problem how do you convert back from ascii to binary/?

It help me with translating

really helpful, thank you

binary to ascii
00110000 = 0 count up in binary to 9 00111001
01000001 Capital ‘A’ count up in binary to ‘Z’ 01011010
01100001 Lowercase ‘a’ count up to ‘z’ 01111010

Most significant nibble 0011 numbers
0100 Capitals
0110 Lowercase

this is fantastic: it helped me translate from binary to real words.

This is great! Fab in class as well 🙂

I love it.
But one thing if converted no has no ASCII code or it is only a symbol then. For example ASCII value of 205 is a symbol then what to do

Источник