Export MySQL query to Excel file: Difference between revisions

From LemonWiki共筆
Jump to navigation Jump to search
Line 8: Line 8:


Notice the limit of Excel XLS file format:
Notice the limit of Excel XLS file format:
* XLS file format<ref>[http://superuser.com/questions/366468/what-is-the-maximum-allowed-rows-in-a-microsoft-excel-xls-or-xlsx What is the maximum allowed rows in a Microsoft Excel .xls or .xlsx - Super User]</ref><ref>[https://support.office.com/en-us/article/Worksheet-compatibility-issues-f9c80c5b-5afc-40da-a841-b888746abd40 Worksheet compatibility issues - Excel]</ref>: Maximum of worksheet size is 65,536 rows by 256 columns. First row is column name. {{exclaim}} Actual data size is 65,535 rows.
<table border="1">
* XLSX file format <ref>[https://support.office.com/en-us/article/Excel-specifications-and-limits-1672b34d-7043-467e-8e27-269d656771c3?ui=en-US&rs=en-US&ad=US&fromAR=1 Excel specifications and limits]</ref>: Maximum of worksheet size is 1,048,576 rows by 16,384 columns.
<tr>
  <th>file format</th>
  <th>data rows size</th>
  <th>length of cloumn</th>
</tr>
<tr>
  <td>XLSX file format<ref>[https://support.office.com/en-us/article/Excel-specifications-and-limits-1672b34d-7043-467e-8e27-269d656771c3?ui=en-US&rs=en-US&ad=US&fromAR=1 Excel specifications and limits]</ref></td>
  <td>Maximum of worksheet size is 1,048,576 rows by 16,384 columns. </td>
  <td>(1) Length of formula contents: 8,192 characters (2) Total number of characters that a cell can contain: 32,767 characters<ref>[http://errerrors.blogspot.com/2016/02/navicat.html Err: 解決 Navicat 「存放裝置空間不足，無法完成此操作」問題訊息]</ref></td>
</tr>
<tr>
  <td>XLS file format<ref>[http://superuser.com/questions/366468/what-is-the-maximum-allowed-rows-in-a-microsoft-excel-xls-or-xlsx What is the maximum allowed rows in a Microsoft Excel .xls or .xlsx - Super User]</ref><ref>[https://support.office.com/en-us/article/Worksheet-compatibility-issues-f9c80c5b-5afc-40da-a841-b888746abd40 Worksheet compatibility issues - Excel]</ref></td>
  <td>Maximum of worksheet size is 65,536 rows by 256 columns. First row is column name. {{exclaim}} Actual data size is 65,535 rows. </td>
  <td></td>
</tr>
</table>


=== Two steps conversion ex: MySQL query -> CSV file -> Excel file===
=== Two steps conversion ex: MySQL query -> CSV file -> Excel file===

Revision as of 12:20, 28 September 2016

Export MySQL query to Excel file (XLS or XLSX file)

Tools

One step conversion: ex MySQL query -> Excel file

Methods of exporting MySQL query -> XLS/XLSX file

Notice the limit of Excel XLS file format:

file format data rows size length of cloumn
XLSX file format[1] Maximum of worksheet size is 1,048,576 rows by 16,384 columns. (1) Length of formula contents: 8,192 characters (2) Total number of characters that a cell can contain: 32,767 characters[2]
XLS file format[3][4] Maximum of worksheet size is 65,536 rows by 256 columns. First row is column name. Icon_exclaim.gif Actual data size is 65,535 rows.

Two steps conversion ex: MySQL query -> CSV file -> Excel file

Step 1: Export the MySQL query -> CSV file 

mysqldump: Got error: 1045: Access denied for user 'user_name'@'localhost' (using password: YES) when executing 'SELECT INTO OUTFILE'

Step 2: Import CSV to XLSX/XLS file format.

Step 3: Data verification

  1. Verify the data rows count: Equal to the rows count of MySQL query. Not equal to 65,535 rows or less than the rows count of MySQL query.
  2. Verify the data column is in correct position
    • Icon_exclaim.gif Because the CSV is not well-formatted, sometimes the data column after imported to Excel is in wrong position. If the data size is less than 65,535 rows, convert CSV to Excel/XLS by LibreOffice Calc is recommended.
    • If the data size is larger than 65,535 rows, Adjust the MySQL query to avoid the column value contains the
      • enclosure character e.g. Tab key
      • escape the enclosure character e.g. "
      • return symbol to separate different data row.

Technical issues: If it costs too much time to convert to Excel file

The important steps before generating CSV file. These steps reduce the problems when the CSV file was converted to Excel file.

  • Add delimiter character between different column ex: comma symbol (,) or tab symbol
  • Add enclosure character ex: double quote symbol (") or single quote symbol (')
  • Add escape character escape the column value if contains the enclosure character
  • Remove return symbol[5]: 
    SELECT REPLACE(REPLACE(REPLACE(`my_column`, '\r\n', '   '), '\n', '   '), '\r', '   ')

References

  1. ↑ Excel specifications and limits
  2. ↑ Err: 解決 Navicat 「存放裝置空間不足，無法完成此操作」問題訊息
  3. ↑ What is the maximum allowed rows in a Microsoft Excel .xls or .xlsx - Super User
  4. ↑ Worksheet compatibility issues - Excel
  5. ↑ trim - How to remove new line characters from data rows in mysql? - Stack Overflow
Retrieved from "https://wiki.planetoid.info/index.php?title=Export_MySQL_query_to_Excel_file&oldid=17346"