phpmysqlpdopropel

Propel ORM: PDOException " Can't create more than max_prepared_stmt_count statements"


I have large MySQL database. I want to fetch rows by 100 at once until all DB is processed.

protected function doEcho($msg){
    static $time, $start;
    if (!$start) $start = time();
    
    if (time() - $time > 0) {
        echo $msg . "\n\n";
        $time = time();
    }
}

// ZF2 action
public function stuffAction() {
    $request = $this->getRequest();
    if (!$request instanceof ConsoleRequest){
        throw new \RuntimeException('You can only use this action from a console!');
    }
    
    // Propel ORM generated Model UserQuery
    $q = \UserQuery::create()->limit(100)->filterByProcessed(0);
    $users = $q->find();        
    
    while ($users->count() ) {
        foreach ($users as $user) {
            $id = $user->getId();
            $email = $user->getEmail();
            $password = $user->getPassword();
            $this->doEcho("$id - $email - $password");
            // do stuff and set processed to 1
        }
        
        $q = \UserQuery::create()->limit(100)->filterByProcessed(0);
        $users = $q->find();
    }
}

I get the following exception raised:

======================================================================
   The application has thrown an exception!
======================================================================
 Propel\Runtime\Exception\PropelException
 Unable to execute SELECT statement [SELECT user.ID, user.EMAIL, user.PASSWORD, user.PHONE, user.IP, user.PROCESSED, user.WHEN FROM `user` WHERE user.PROCESSED=:p1 LIMIT 100]
----------------------------------------------------------------------


// debug backtrace

======================================================================
   Previous Exception(s):
======================================================================
 PDOException
 SQLSTATE[42000]: Syntax error or access violation: 1461 Can't create more than max_prepared_stmt_count statements (current value: 16382)
----------------------------------------------------------------------

// debug backtrace

Obviously, the reason is that:

An application connecting to the database was preparing sql statements, executing them, then not closing them.

How do I make Propel to close statements ? I do use Propel 2: "propel/propel": "2.0.*@dev"


Solution

  • Solved:

    use Propel\Runtime\Propel;
    use Propel\Runtime\Connection\ConnectionWrapper;
    
    // ...
    
    Propel::getServiceContainer()
        // connection_name - connection from propel config
        ->getReadConnection('connection_name')
        ->setAttribute(ConnectionWrapper::PROPEL_ATTR_CACHE_PREPARES, true);