IBM Cloud - Structured Ideas
Hide about this portal
This portal is to open public enhancement requests against IBM Cloud and its products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
Shape the future of IBM!
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Search existing ideas
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,
Post your ideas
Post an idea.
Get feedback from the IBM team and other customers to refine your idea.
Follow the idea through the IBM Ideas process.
Specific links you will want to bookmark for future use
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
IBM Cloud Support Center (https://cloud.ibm.com/unifiedsupport/cases/form) – Use this site for any IBM Cloud defect or support need.
Stack Overflow (https://stackoverflow.com/questions/tagged/ibm-cloud) – Use this site for IBM Cloud technical Q&A using the tag "ibm-cloud".
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.
Hello Venkat,
I just send a comment, but I don't it published.
You are absolutely right, we don't need exactly the parquet extension, but we need at least a fwd for S3, just like https://fdw.dev/catalog/s3/
But the wrapper extension is not present on IBM Cloud psql (https://cloud.ibm.com/docs/databases-for-postgresql?topic=databases-for-postgresql-extensions#available-extensions)
We are running a SaaS service on k8s and need to dump some tables for a customer to reach, and would like to enable him through S3
We have Liberty and OpenLiberty microservices, and we would prefer to export these tables with Java rather than with spin up a pod with the pg_dump installed on it.
Thanks
Eugenio
Hello Venkat,
I just send a comment, but I don't it published.
You are absolutely right, we don't need exactly the parquet extension, but we need at least a fwd for S3, just like https://fdw.dev/catalog/s3/
But the wrapper extension is not present on IBM Cloud psql (https://cloud.ibm.com/docs/databases-for-postgresql?topic=databases-for-postgresql-extensions#available-extensions)
We are running a SaaS service on k8s and need to dump some tables for a customer to reach, and would like to enable him through S3
We have Liberty and OpenLiberty microservices, and we would prefer to export these tables with Java rather than with spin up a pod with the pg_dump installed on it.
Thanks
Eugenio
Hello Venkat,
yes, sure.
We are running a SaaS service on kubernetes and we need to periodically export some tables for a customer outside IBM Cloud.
We would like to enable him to an S3 Bucket, where he can find the exports without the need to use a jump host (the db has only private endpoints).
We would avoid, if possible, the pg_dump, since we are using Liberty and Openliberty webserver, so we would like to dump data via Java, rather than spinning up a pod with pg_dump installed on it.
This said, you are absolutely right, it doesn't need to be dedicated to parquet file, even an s3_wrapper (like https://fdw.dev/catalog/s3/) is fine.
But it needs the wrapper extension, which is currently not available (https://cloud.ibm.com/docs/databases-for-postgresql?topic=databases-for-postgresql-extensions)
So it would be feasible to add a fdw for s3 as an extension?
Thanks
Eugenio
Hi Eugenio,
Thank you for your patience.
I am looking for some more details. Could you please explain this use case?
Could you explain why you are requesting a Parquet export extension when you stated that the requirement is for CSV export? Specifically, why is pg_dump for CSV inadequate for your needs, particularly if your goal is to externalize tables to a storage or local file system?
Thank you, and I look forward to hearing from you.
Which kind of more information do you need?
Thanks