pythonregexfederated-storage-engine

Replace all occurences of regex string with info from input+string


I have a sql nodata dump, and I need to go through it and replace the engine part of each create table query. The point where I am stuck is that I need to mention the table name in each string i am replacing with for the respective table

Assuming a file as below

CREATE TABLE `tablename1` (
  -- #columns and keys
) ENGINE=InnoDB AUTO_INCREMENT=5075 DEFAULT CHARSET=utf8;
CREATE TABLE `tablename2` (
  -- #columns and keys
) ENGINE=something AUTO_INCREMENT=55 DEFAULT CHARSET=latin1;

The desired result is:

CREATE TABLE `tablename1` (
  -- #columns and keys
) ENGINE=-myreplacedstring/tablename1; -- #table name 1 is appended to this line
CREATE TABLE `tablename2` (
  -- #columns and keys
) ENGINE=myreplacedstring/tablename2; -- #table name 2 is appended to this line

I tried

fin = open('dump.sql','r')
filedata = fin.read()
fin.close()

newdata = re.sub('(?<=ENGINE).*;', '-myreplacedstring-', filedata)

fout = open('fed_dump.sql','w')
fout.write(newdata)
fout.close()

but this only replaces the string with a fixed string, regardless of which table it is.

I also tried to approach row by row to be able to grab the table name every time I pass it, but I am not sure how to proceed with this.

 with open('dump.sql') as infile, open('dump_fed.sql', 'w') as outfile:
     for line in infile:
         #tablename= if line contains create table, update tablename, else do nothing
         line = re.sub('(?<=ENGINE).*;', '-myreplacedstring-'+tablename, line)
         outfile.write(line)

I am stuck on how to get the table name for each table into my replaced string. Any help is appreciated.


Solution

  • Your solution will certainly work, but you can do it quicker with backreferences. I tested this and it works (you could make it a one-liner but it´s more readable this way) :

    pattern = r"CREATE TABLE `(.*?)`(.*?)ENGINE=.*?;"
    replace_pattern = r"CREATE TABLE `\1`\2ENGINE=-myreplacedstring-\1;"
    newdata = re.sub(pattern, replace_pattern, filedata, flags=re.DOTALL)
    

    With :

    I proposed before the following solution, which is wrong because look-behinds, signaled by "(?<=...)", must contain fixed length patterns :

    pattern = r"(?<=CREATE TABLE `(.*?)`.*?ENGINE=).*;"
    newdata = re.sub(pattern, '-myreplacedstring-\1', filedata)