Data cleaning: Difference between revisions

Jump to navigation Jump to search
1,181 bytes removed ,  13 August 2020
Line 290: Line 290:
</pre>
</pre>


=== Time data: Verify the data format ===
=== Time data: Validate the data format ===
Verify the value by using MySQL functions:
[[Validate the datetime value]]
 
Verify the value should be year-month-day format e.g. {{Template:Today}}
<pre>
SELECT `my_date_column`, UNIX_TIMESTAMP(STR_TO_DATE(`my_date_column`, '%Y-%m-%d'))
FROM `my_table`
WHERE
UNIX_TIMESTAMP(STR_TO_DATE(`my_date_column`, '%Y-%m-%d')) IS NULL;
 
</pre>
 
Verify the value should be year/month/day format
<pre>
SELECT `my_date_column`, UNIX_TIMESTAMP(STR_TO_DATE(`my_date_column`, '%Y/%m/%d'))
FROM `my_table`
WHERE
UNIX_TIMESTAMP(STR_TO_DATE(`my_date_column`, '%Y/%m/%d')) IS NULL;
 
</pre>
 
Verify the value should be hour:minute:second format e.g. {{CURRENTTIME}}:06
<pre>
SELECT `my_time_column`, UNIX_TIMESTAMP(STR_TO_DATE(`my_time_column`, '%H:%i:%S'))
FROM `my_table`
WHERE
UNIX_TIMESTAMP(STR_TO_DATE(`my_time_column`, '%H:%i:%S')) IS NULL;
 
</pre>
 
Verify the value should be year-month-day hour:minute:second format e.g. {{Template:Today}} {{CURRENTTIME}}:06
<pre>
SELECT `my_time_column`, UNIX_TIMESTAMP(STR_TO_DATE(`my_time_column`, '%Y-%m-%d %H:%i:%S'))
FROM `my_table`
WHERE
UNIX_TIMESTAMP(STR_TO_DATE(`my_time_column`, '%Y-%m-%d %H:%i:%S')) IS NULL;
 
</pre>
 
Alternative PHP solution: [https://www.php.net/manual/en/function.strtotime.php strtotime]


=== Time data: Data was generated in 10 years ===
=== Time data: Data was generated in 10 years ===
Anonymous user

Navigation menu