MySQL RDS read replica service is not purging binlogs
We have a replica read database for MySQL (5.6.41) on AWS RDS service, which worked OK for the last 2 years, but it suddenly started to behave very differently during last 3 weeks: it uses space and is not normally returning it back. So I had to buy more storage for it to continue operating (you can see 2 peaks in the screenshot).
As I see the problem is that some daemon is automatically calling PURGE BINARY LOGS BEFORE 'mysql-bin-changelog.10xxxx'; but that log "10xxxx" is not deleted and just stays there. I've checked INNODB MONITOR OUTPUT, there is NO long time active transactions, show processlist shows NOTHING, yet ~100% CPU is used
space is not reclaiming! SHOW BINARY LOGS; shows >5200 records and this number continues to grow.
I've tried to close all incoming connections, even turned off "event scheduler" and replication process. Still the picture is not healthy:
CPU is just stuck at >50%! And there are NO sessions in DB (just rdsadmin@localhost)
Can you help me with the cause and how to recover? Because for now I have to buy ~50GB per 3-4 days for "nothing".
For now ANSWER: we've contacted AWS Support (paid developer support), but they did not find anything special and said that the problem is on their side in hardware probably. So we had to create new replica and migrate our custom schemas to it, killed the problematic one after that.
I will answer own question, because have not found any better solution, even after contacting and investigating with AWS Support.
We've contacted AWS Support (paid developer support), but they did not find anything special and said that the problem is on their side in hardware probably. So we had to create new replica and migrate our custom schemas to it, killed the problematic one after that.
- Why is my docker.compose file not creating my database?
- "Database logon failed" in Crystal Reports when using System DSN for MySQL Server
- Can I access the MySQL keypair in a plugin?
- MySQL - Update table values from another table
- Find patients admitted multiple times for the same primary diagnosis in SQL
- Connecting a Dockerized Spring Boot app to a local MySQL Database
- MySql: unknown column id in 'field list'
- Is there a simple tool to convert mysql to postgresql syntax?
- Why UNION and UNION ALL don't work in my code?
- laravel eloquent ->whereHas - write your own exists( subquery )
- MySQL server does not start with MAMP
- Forward Engineer not creating tables from Model in MySQL Workbench
- How can I make SQL case sensitive string comparison on MySQL?
- MySQL - problem with comparing strings constants containing national characters
- How to fix "java.sql.SQLException: Can't call commit when autocommit=true"
- Balance calculation problem with Foreign Exchange in Mysql
- Database Backup From Laravel Application
- Joining tables with multiple results as new columns?
- how to calculate average price of each item in inventory php mysql
- #1045 - Access denied for user 'root'@'localhost' (using password: YES)
- How can I rebuild indexes and update stats in MySQL innoDB?
- In MySQL, how can I create a stored procedure to create the database itself and then call this procedure from Java using JDBC?
- InnoDB: Unable to lock ./ibdata1 error: 35
- MySQL Order subquery by the order that fields from another table come in
- UPDATE/INSERT when modifying RDBMSs using drill
- Searching within nested JSON entries in MYSQL
- Selecting empty mysql datetime fields
- SQL Query: order by length of characters?
- how do i add database name with hyphen character using script in ubuntu
- Laravel 11 forces creation of tables you don't want and crashes the app