Discussion:
[Veritas-ha] Volume resize fails with vxresize
Jørgen Henriksen
2007-09-17 10:57:37 UTC
Permalink
Hi,



Just tried to resize a volume in Storage Foundation 4.1, and ended up with the following error:



UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize /dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM vxresize ERROR V-5-1-7514 Problem running fsadm command for volume dummyvol01, in diskgroup dummydg



When I tried to fsck the volume, it just aborted. This is an Oracle Rac configuration, and I used the "fsclustadm showprimary" and "fsclustadm setprimary" together with "vxdctl -c mode" to assure the right host for the operation. The vxresize command was issued from VEA, and it made the volume unusable, and took down the entire production cluster. The issue was resolved by resizing the volume manually with vxassist, and then fsck on the volume. Everything is now back to normal, but why did this happen ? Anyone ?



Best regards Jørgen Henriksen

Ementor AS

Norway
Jørgen Henriksen
2007-09-17 12:41:16 UTC
Permalink
Hi,

Thanks for the quick response. Volume was 93% full. Have done the vxresize with less free space on volume, although I know there's a 10% "recommended" value coming out of Symantec documentation. I'm not fully convinced that this is the problem, but it might be a contributing factor.

/jørgen



________________________________

From: Ketan Patel [mailto:***@gmail.com]
Sent: 17. september 2007 13:33
To: Jørgen Henriksen
Subject: Re: [Veritas-ha] Volume resize fails with vxresize



Hi Jorgen,



When you ran varesize, how much full was dummyvol01? Was it higher 90s%? That was the probable reason - vxresize requires some space to hold the data temporary but if there is no space, it will hang.



Also, the better suggestion in cases when FS is almost full, first fragment the file system using fsadm and not more than 10-15% at a time. This is much faster. Once the whole FS is fragmented, you can start expansion.



thanks

ketan


On 9/17/07, Jørgen Henriksen <***@ementor.no> wrote:



Hi,



Just tried to resize a volume in Storage Foundation 4.1, and ended up with the following error:



UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize /dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM vxresize ERROR V-5-1-7514 Problem running fsadm command for volume dummyvol01, in diskgroup dummydg



When I tried to fsck the volume, it just aborted. This is an Oracle Rac configuration, and I used the "fsclustadm showprimary" and "fsclustadm setprimary" together with "vxdctl -c mode" to assure the right host for the operation. The vxresize command was issued from VEA, and it made the volume unusable, and took down the entire production cluster. The issue was resolved by resizing the volume manually with vxassist, and then fsck on the volume. Everything is now back to normal, but why did this happen ? Anyone ?



Best regards Jørgen Henriksen

Ementor AS

Norway




_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu <mailto:Veritas-***@mailman.eng.auburn.edu>
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
Santosh Jambhlikar
2007-09-17 12:42:39 UTC
Permalink
Can you try
vxresize -g dummydg dummyvol01 +10m
Post by Jørgen Henriksen
Hi,
Just tried to resize a volume in Storage Foundation 4.1,
UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize
/dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM
vxresize ERROR V-5-1-7514 Problem running fsadm command
for volume dummyvol01, in diskgroup dummydg
When I tried to fsck the volume, it just aborted. This is
an Oracle Rac configuration, and I used the "fsclustadm
showprimary" and "fsclustadm setprimary" together with
"vxdctl -c mode" to assure the right host for the
operation. The vxresize command was issued from VEA, and
it made the volume unusable, and took down the entire
production cluster. The issue was resolved by resizing
the volume manually with vxassist, and then fsck on the
volume. Everything is now back to normal, but why did
this happen ? Anyone ?
Best regards Jørgen Henriksen
Ementor AS
Norway
Post by Jørgen Henriksen
_______________________________________________
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Tonight's top picks. What will you watch tonight? Preview the hottest shows on Yahoo! TV.
http://tv.yahoo.com/
Jørgen Henriksen
2007-09-17 12:47:04 UTC
Permalink
Hi,
No. The task is completed, and all the allocated storage from the clients SAN, was configured using the vxassist command. Just wondering if anyone have seen the same situation on their VCS environments. Have done the same operations on SFHA 5.0 without incidents.

Thanks
Jørgen

-----Original Message-----
From: Santosh Jambhlikar [mailto:***@yahoo.com]
Sent: 17. september 2007 14:43
To: Jørgen Henriksen; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

Can you try
vxresize -g dummydg dummyvol01 +10m
Post by Jørgen Henriksen
Hi,
Just tried to resize a volume in Storage Foundation 4.1,
UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize
/dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM
vxresize ERROR V-5-1-7514 Problem running fsadm command
for volume dummyvol01, in diskgroup dummydg
When I tried to fsck the volume, it just aborted. This is
an Oracle Rac configuration, and I used the "fsclustadm
showprimary" and "fsclustadm setprimary" together with
"vxdctl -c mode" to assure the right host for the
operation. The vxresize command was issued from VEA, and
it made the volume unusable, and took down the entire
production cluster. The issue was resolved by resizing
the volume manually with vxassist, and then fsck on the
volume. Everything is now back to normal, but why did
this happen ? Anyone ?
Best regards Jørgen Henriksen
Ementor AS
Norway
Post by Jørgen Henriksen
_______________________________________________
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Tonight's top picks. What will you watch tonight? Preview the hottest shows on Yahoo! TV.
http://tv.yahoo.com/
Cronin, John S
2007-09-17 13:22:04 UTC
Permalink
I recall seeing something somewhere that using vxresize on CVM/CFS can fail because the CFS primary (not sure about terminology, I haven't used CVM/CFS much) can be on a different node than the CVM primary. The solution was to check if this is the case, and if so, resize the volume on the CVM primary, and then grow the filesystem in a separate operation on the CFS primary.

By the power of Google, I found it; this has to do with VCS hacli as well, but it MAY apply to your situation:

http://www.mail-archive.com/veritas-***@mailman.eng.auburn.edu/msg01142.html
--
John Cronin
678-480-6266

-----Original Message-----
From: veritas-ha-***@mailman.eng.auburn.edu [mailto:veritas-ha-***@mailman.eng.auburn.edu] On Behalf Of Jørgen Henriksen
Sent: Monday, September 17, 2007 8:47 AM
To: Santosh Jambhlikar; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

Hi,
No. The task is completed, and all the allocated storage from the clients SAN, was configured using the vxassist command. Just wondering if anyone have seen the same situation on their VCS environments. Have done the same operations on SFHA 5.0 without incidents.

Thanks
Jørgen

-----Original Message-----
From: Santosh Jambhlikar [mailto:***@yahoo.com]
Sent: 17. september 2007 14:43
To: Jørgen Henriksen; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

Can you try
vxresize -g dummydg dummyvol01 +10m
Post by Jørgen Henriksen
Hi,
Just tried to resize a volume in Storage Foundation 4.1, and ended up
UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize
/dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM vxresize
ERROR V-5-1-7514 Problem running fsadm command for volume dummyvol01,
in diskgroup dummydg
When I tried to fsck the volume, it just aborted. This is an Oracle
Rac configuration, and I used the "fsclustadm showprimary" and
"fsclustadm setprimary" together with "vxdctl -c mode" to assure the
right host for the operation. The vxresize command was issued from
VEA, and it made the volume unusable, and took down the entire
production cluster. The issue was resolved by resizing the volume
manually with vxassist, and then fsck on the volume. Everything is now
back to normal, but why did this happen ? Anyone ?
Best regards Jørgen Henriksen
Ementor AS
Norway
Post by Jørgen Henriksen
_______________________________________________
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Tonight's top picks. What will you watch tonight? Preview the hottest shows on Yahoo! TV.
http://tv.yahoo.com/


_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha

*****

The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential, proprietary, and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from all computers. GA623
Cronin, John S
2007-09-17 13:25:38 UTC
Permalink
I hate to respond to my own post but I just noticed you stated that you ran fsclustadm to verify you had the right node - I presume the commands you ran checked to see which node was the CFS primary and/or set the node you wanted to be the CFS primary. That would make my suggestion irrelevant.
--
John Cronin
678-480-6266

-----Original Message-----
From: veritas-ha-***@mailman.eng.auburn.edu [mailto:veritas-ha-***@mailman.eng.auburn.edu] On Behalf Of Cronin, John S
Sent: Monday, September 17, 2007 9:22 AM
To: Jørgen Henriksen; Santosh Jambhlikar; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

I recall seeing something somewhere that using vxresize on CVM/CFS can fail because the CFS primary (not sure about terminology, I haven't used CVM/CFS much) can be on a different node than the CVM primary. The solution was to check if this is the case, and if so, resize the volume on the CVM primary, and then grow the filesystem in a separate operation on the CFS primary.

By the power of Google, I found it; this has to do with VCS hacli as well, but it MAY apply to your situation:

http://www.mail-archive.com/veritas-***@mailman.eng.auburn.edu/msg01142.html

--
John Cronin
678-480-6266

-----Original Message-----
From: veritas-ha-***@mailman.eng.auburn.edu [mailto:veritas-ha-***@mailman.eng.auburn.edu] On Behalf Of Jørgen Henriksen
Sent: Monday, September 17, 2007 8:47 AM
To: Santosh Jambhlikar; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

Hi,
No. The task is completed, and all the allocated storage from the clients SAN, was configured using the vxassist command. Just wondering if anyone have seen the same situation on their VCS environments. Have done the same operations on SFHA 5.0 without incidents.

Thanks
Jørgen

-----Original Message-----
From: Santosh Jambhlikar [mailto:***@yahoo.com]
Sent: 17. september 2007 14:43
To: Jørgen Henriksen; veritas-***@mailman.eng.auburn.edu
Subject: Re: [Veritas-ha] Volume resize fails with vxresize

Can you try
vxresize -g dummydg dummyvol01 +10m
Post by Jørgen Henriksen
Hi,
Just tried to resize a volume in Storage Foundation 4.1, and ended up
UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize
/dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM vxresize
ERROR V-5-1-7514 Problem running fsadm command for volume dummyvol01,
in diskgroup dummydg
When I tried to fsck the volume, it just aborted. This is an Oracle
Rac configuration, and I used the "fsclustadm showprimary" and
"fsclustadm setprimary" together with "vxdctl -c mode" to assure the
right host for the operation. The vxresize command was issued from
VEA, and it made the volume unusable, and took down the entire
production cluster. The issue was resolved by resizing the volume
manually with vxassist, and then fsck on the volume. Everything is now
back to normal, but why did this happen ? Anyone ?
Best regards Jørgen Henriksen
Ementor AS
Norway
Post by Jørgen Henriksen
_______________________________________________
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Tonight's top picks. What will you watch tonight? Preview the hottest shows on Yahoo! TV.
http://tv.yahoo.com/


_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha

*****

The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential, proprietary, and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from all computers. GA623



_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
Munish Dhawan
2007-09-17 13:45:06 UTC
Permalink
Hi Jorgen,

Errno 16 means "Mount device busy". There are three primary causes for this
error:

1. The file system is too busy to be resized.

Although resizing a file system requires that the file system be
mounted, one must "freeze" the file system to actually perform the resize. Freezing will temporarily prevent new accesses to the file system, but it is necessary to wait for pending I/O's to complete. If it is not possible to freeze the file system quickly, stating
that the file system is too busy is given up.

2. The file system has a snapshot file system mounted on it.

If a snapshot file system was mounted on the file system being
resized, the resize will fail. File systems that have
snapshots mounted on them cannot be resized.

3. The file system may have corruption and needs to be fsck'd.

A file system that has experienced structural damage and is marked
for full fsck cannot be resized.

RESOLUTION:

Make sure that the file system does not have any snapshot file system
mounted on it. Attempt the resize when the file system has less of a
load on it.
If it continues to fail with "errno 16" then unmount the file system,
perform "fsck -o full", remount, and try again.
=


Jørgen Henriksen <***@ementor.no> wrote:
st1\:*{behavior:url(#default#ieooui) }
Hi,

Just tried to resize a volume in Storage Foundation 4.1, and ended up with the following error:

UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize /dev/vx/rdsk/dummydg/dummyvol01 failed with errno 16 VxVM vxresize ERROR V-5-1-7514 Problem running fsadm command for volume dummyvol01, in diskgroup dummydg

When I tried to fsck the volume, it just aborted. This is an Oracle Rac configuration, and I used the “fsclustadm showprimary” and “fsclustadm setprimary” together with “vxdctl –c mode” to assure the right host for the operation. The vxresize command was issued from VEA, and it made the volume unusable, and took down the entire production cluster. The issue was resolved by resizing the volume manually with vxassist, and then fsck on the volume. Everything is now back to normal, but why did this happen ? Anyone ?

Best regards Jørgen Henriksen
Ementor AS
Norway


_______________________________________________
Veritas-ha maillist - Veritas-***@mailman.eng.auburn.edu
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha



Thanks & Regards,
Munish Dhawan

---------------------------------
Got a little couch potato?
Check out fun summer activities for kids.
Dan Barnes
2007-09-17 18:54:45 UTC
Permalink
Was the volume 100% full before you attempted
vxresize?

- db
Post by Jørgen Henriksen
Hi,
No. The task is completed, and all the allocated
storage from the clients SAN, was configured using
the vxassist command. Just wondering if anyone have
seen the same situation on their VCS environments.
Have done the same operations on SFHA 5.0 without
incidents.
Thanks
Jørgen
-----Original Message-----
From: Santosh Jambhlikar
Sent: 17. september 2007 14:43
To: Jørgen Henriksen;
Subject: Re: [Veritas-ha] Volume resize fails with
vxresize
Can you try
vxresize -g dummydg dummyvol01 +10m
Post by Jørgen Henriksen
Hi,
Just tried to resize a volume in Storage
Foundation 4.1,
Post by Jørgen Henriksen
UX:vxfs fsadm: ERROR: V-3-20340: attempt to resize
/dev/vx/rdsk/dummydg/dummyvol01 failed with errno
16 VxVM
Post by Jørgen Henriksen
vxresize ERROR V-5-1-7514 Problem running fsadm
command
Post by Jørgen Henriksen
for volume dummyvol01, in diskgroup dummydg
When I tried to fsck the volume, it just aborted.
This is
Post by Jørgen Henriksen
an Oracle Rac configuration, and I used the
"fsclustadm
Post by Jørgen Henriksen
showprimary" and "fsclustadm setprimary" together
with
Post by Jørgen Henriksen
"vxdctl -c mode" to assure the right host for the
operation. The vxresize command was issued from
VEA, and
Post by Jørgen Henriksen
it made the volume unusable, and took down the
entire
Post by Jørgen Henriksen
production cluster. The issue was resolved by
resizing
Post by Jørgen Henriksen
the volume manually with vxassist, and then fsck
on the
Post by Jørgen Henriksen
volume. Everything is now back to normal, but why
did
Post by Jørgen Henriksen
this happen ? Anyone ?
Best regards Jørgen Henriksen
Ementor AS
Norway
Post by Jørgen Henriksen
_______________________________________________
Veritas-ha maillist -
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Post by Jørgen Henriksen
Tonight's top picks. What will you watch tonight?
Preview the hottest shows on Yahoo! TV.
http://tv.yahoo.com/
_______________________________________________
Veritas-ha maillist -
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-ha
____________________________________________________________________________________
Yahoo! oneSearch: Finally, mobile search
that gives answers, not web links.
http://mobile.yahoo.com/mobileweb/onesearch?refer=1ONXIC

Loading...