SQL Azure Management - Backup and Monitoring

SQL Azure Backup and Restore
SQL Azure does not support the normal SQL Server BACKUP commands.

It does provide inherent data redundancy and reliability. However, this will not help if:

• There is an app bug which corrupts your data.
• There's a hacker who destroys your data
• The Microsoft's datacenter loses all of your data (unlikely but possible)

To cope with these scenarios, there are two mechanisms currently available to backup your data:

• You can use the SQL Azure copy commands to copy your database contents to a second, still stored within SQL Azure - this will protect again only the first problem above (assuming the hacker has a way into your Azure store)
• You can use the open source SQL Azure Migration Wizard to download data to a local copy - this will provide a recovery mechanism for all 3 items above

The use of this second tool is discussed further below:

SQL Azure Data Migration

Warning - using this for a backup process will involve a large amount of data transfer (which will cost money), but it's better than not having a backup at all.

Backup

To use this tool:

1. download it from http://sqlazuremw.codeplex.com/
2. choose "Analyze and migrate T-SQL database"
3. choose the Azure database - yourserver.database.windows.net - username - username@yourserver - and password.
4. Note that you can only connect to the SQL azure database from IP addresses whitelisted on the firewall settings on the SQL Azure web control panel
5. choose "[databaseName]"
6. choose "script all database objects"
7. hit "next" and it will slowly happen
8. choose your local SQL server to connect to
9. create a new SQL server database
10. hit "next" to insert the data into your local database

For restore, you need to go in the opposite direction

Restore

To do this:

1. typically suspend the Azure web application
2. use the Azure web user interface to drop the existing SQL Azure database
3. run the steps above in reverse - from local to SQL Azure
4. restart the Azure web application.

Notes:

• - dependent on the technical level of the user - or if there's an automation server available, this backup process can be scripted using command line arguments - see the documentation for batch mode - http://sqlazuremw.codeplex.com/releases/view/32334#DownloadId=125697
• - this backup process should perhaps be combined with copy to ensure that the data downloaded is transactionally consistent (http://www.azuresupport.com/2010/08/sql-azure-backup-database-copy/). To do this:

1. connect to SQL Azure using SQL Server Management Studio
2. open a "New Query"
3. type "CREATE DATABASE backupName AS COPY OF mainName"
4. Hit Execute
   
   The state of the copy can then be monitored using "select name, state, state_desc from sys.databases where name = 'backupName"
   

Note that costs of running multiple databases on Azure suggest that you should not keep taking more and more backups and storing them all within SQL Azure.

SQL Azure Monitoring
There really isn't much that can currently be done in the way of monitoring the health of an Azure SQL Server.

This http://msdn.microsoft.com/en-us/library/ff394114.aspx document describes the ability to query:

• Database size
• Number of connections - and their activity
• Some simple query performance

However, this doesn't really provide any clue as to monitoring the database "health" - e.g. uptime/status, loading, etc.

There is some access to overall status at http://www.microsoft.com/windowsazure/support/status/servicedashboard.aspx - but this is at a very coarse level.

The only current suggestions for checking a SQL server instance is alive are:

• just rely on Microsoft uptime (under their SLA) - not ideal
• use tools like Nagios to add "HTTP" monitoring to Azure applications connected to the SQL Server database - use this web monitoring to check the health of the server (at least to check it is alive).
• try to build something (e.g. a web app) based around sys.dm_exec_connections (http://msdn.microsoft.com/en-us/library/ff394114.aspx) which would provide some analysis of loading.
• try to extend the enzo SQL library - http://enzosqlbaseline.codeplex.com/ - it's benchmarking tools might give you some clue on current loading (but this monitoring might also impact your current performance).

If you can't run the Visual Studio wizard for SharpArchitecture

If you see a series of messages like "A problem was encountered
creating the sub project 'sharp.Core'. A project with that name is
already opened in the solution."

Then it could be due to problems with AnkhSVN - see
http://www.softweb.net.au/blogs/development/sharp-architecture-new-project-wizard-is-incompatible-with-ankhsvn

So I had to uninstall source control to get it working....

Azure - stuck in Initialising-Busy-Stopping...repeat

This link seems a good reference!

 

http://blog.toddysm.com/2010/01/windows-azure-deployment-stuck-in-initializing-busy-stopping-why.html

Some points:

• missing dependencies
• problems with initialising WAD (Azure Diagnostics connection string)
• problems with other connection strings
• lack of permission (medium trust!)

If you hit a problem with ConfigMonitoringPoll - Polling for configuration changes - when using Azure Diagnostics

Reported as:

Polling for configuration changes:Microsoft.WindowsAzure.StorageClient.StorageClientException: The specified blob does not exist. ---> System.Net.WebException: The remote server returned an error: (404) Not Found. at System.Net.HttpWebRequest.EndGetResponse(IAsyncResult asyncResult) at Microsoft.WindowsAzure.StorageClient.EventHelper.ProcessWebResponse(WebRequest req, IAsyncResult asyncResult, EventHandler`1 handler, Object sender) --- End of inner exception stack trace --- at Microsoft.WindowsAzure.StorageClient.Tasks.Task`1.get_Result() at Microsoft.WindowsAzure.StorageClient.Tasks.Task`1.ExecuteAndWait() at Microsoft.WindowsAzure.StorageClient.CloudBlob.DownloadToStream(Stream target, BlobRequestOptions options) at Microsoft.WindowsAzure.Diagnostics.ControlChannel.<>c__DisplayClass10.<ConfigMonitoringPoll>b__f() at Microsoft.WindowsAzure.Diagnostics.ControlChannel.TryExpectError(HttpStatusCode status, Action act) at Microsoft.WindowsAzure.Diagnostics.ControlChannel.ConfigMonitoringPoll(Object sender, ElapsedEventArgs args); TraceSource 'WaWebHost.exe' event

Then the problem might be that you must initialise the Azure Diagnostics from the start of the WebRole - and not from the start of app in Global.asax - just add this new file to your webrole project:

using System;

using System.Collections.Generic;

using System.Linq;

using System.Web;

using Microsoft.WindowsAzure.ServiceRuntime;

namespace MyProject.Web

{

public class WebRole : RoleEntryPoint

{

public override bool OnStart()

{

AzureDiagnostics.InitializeAzureDiagnostics();

return base.OnStart();

}

}

}

Adding Diagnostic monitoring to Azure

If you want to get some diagnostics from Windows Azure deployed applications then follow the instructions on: http://msdn.microsoft.com/en-us/library/ee843890

This gives you a solution like:

    public static class AzureDiagnostics

    {

        public static void InitializeAzureDiagnostics()

        {

            // do not run this code if we're not running in the cloud.

            if (!Microsoft.WindowsAzure.ServiceRuntime.RoleEnvironment.IsAvailable)

                return;

 

            // Enabled the capture of partial crash dumps

            Microsoft.WindowsAzure.Diagnostics.CrashDumps.EnableCollection(false);

 

            // configure and start the diagnostics

            DiagnosticMonitorConfiguration dmc = DiagnosticMonitor.GetDefaultInitialConfiguration();

 

            AddPerformanceCounters(dmc);

            AddLogs(dmc);

            AddSystemEventLog(dmc);

            AddInfrastructureLogs(dmc);

 

            DiagnosticMonitor.Start("DiagnosticsConnectionString", dmc);

        }

 

        private static void AddInfrastructureLogs(DiagnosticMonitorConfiguration dmc)

        {

            dmc.DiagnosticInfrastructureLogs.ScheduledTransferLogLevelFilter = LogLevel.Verbose;

            dmc.DiagnosticInfrastructureLogs.ScheduledTransferPeriod = TimeSpan.FromMinutes(10.0);

        }

 

        private static void AddSystemEventLog(DiagnosticMonitorConfiguration dmc)

        {

            // Add event collection from the Windows Event Log

            dmc.WindowsEventLog.DataSources.Add("System!*");

            dmc.WindowsEventLog.ScheduledTransferLogLevelFilter = LogLevel.Verbose;

            dmc.WindowsEventLog.ScheduledTransferPeriod = TimeSpan.FromMinutes(10);

        }

 

        private static void AddLogs(DiagnosticMonitorConfiguration dmc)

        {

            dmc.Logs.ScheduledTransferPeriod = TimeSpan.FromMinutes(10);

            dmc.Logs.ScheduledTransferLogLevelFilter = LogLevel.Verbose;           

        }

 

        private static void AddPerformanceCounters(DiagnosticMonitorConfiguration dmc)

        {

            List<string> counters = new List<string>();

            counters.Add(@"\Processor(_Total)\% Processor Time");

            counters.Add(@"\Memory\Available Mbytes");

            counters.Add(@"\TCPv4\Connections Established");

            counters.Add(@"\ASP.NET Applications(__Total__)\Requests/Sec");

            // These network interfaces removed - not that interesting for now

            //counters.Add(@"\Network Interface(*)\Bytes Received/sec");

            //counters.Add(@"\Network Interface(*)\Bytes Sent/sec");

            foreach (string counter in counters)

            {

                PerformanceCounterConfiguration counterConfig = new PerformanceCounterConfiguration();

                counterConfig.CounterSpecifier = counter;

                counterConfig.SampleRate = TimeSpan.FromSeconds(10);

                dmc.PerformanceCounters.DataSources.Add(counterConfig);

            }

            dmc.PerformanceCounters.ScheduledTransferPeriod = TimeSpan.FromMinutes(5.0);

        }

    }

 

 

Re: "The "COM0" port did not open." Bada device development

If you're trying to debug a Bada device and you see "The "COM0" port
did not open." under the entry for the Broker.exe in the Bada IDE
Console, then:

1. If it's the first time you've ever tried to connect then check that
you've installed the necessary USB drivers and have the device
attached.
2. If you've previously been using this fine, but this has suddenly
stopped working then try:
--- rebooting your phone
--- killing broker.exe in the PC task manager
--- setting your phone's USB connect to Samsung Kies or to Mass
Storage, and then using Run As rather than Debug As in the IDE
--- hit the task manager on the phone and choose "End All Applications"

I'm not entirely sure what worked for me... but I think it was a
combination of the last few in the end!

Setting up a Samsung Wave (Bada) for debugging

Full instructions here - http://www.careace.net/2010/08/07/run_your_wave_app_on_actualdevice/

So far seems to work very well (although it does seem to help if you disconnect and reconnect the Wave between each debug session!)

View Stored Procedure Source Code

If you want to see the raw SQL behind your stored proc (like you can
in SQL Server Management Studio) then use:

EXEC sp_HelpText 'your procedure name'

Found in http://stackoverflow.com/questions/467482/how-do-i-programmatically-retrieve-sql-server-stored-procedure-source-that-is-ide

A problem with "The server committed a protocol violation. Section=ResponseHeader Detail=CR must be followed by LF"

Something changed on one of the web services I was using - suddenly one of my requests was failing with a WebException - 

The server committed a protocol violation. Section=ResponseHeader Detail=CR must be followed by LF

To fix this I had to add this to my web.config/app.config:

<system.net>
    <settings>
      <httpWebRequest useUnsafeHeaderParsing="true" />
    </settings>
</system.net>

Simples ;)

Low Pass Javascript

As part of the runsat work, I've had a continual battle to get elevation results "realistic"

This is particularly challenging because of "noise" in the sampled elevation data.

The latest attempt at this, has been to use a low pass filter - based on work at http://mshook.appspot.com/z/firkernel.htm - to smooth the elevation data.

You can see the effect:

Speeding up ASP.NET debugging on XP (I hope!)

From http://www.dotnetnuke.com/Community/Blogs/tabid/825/EntryId/2579/A-small-web-config-setting-that-can-save-you-development-time.aspx

The original line reads:

     <compilation debug="true" strict="false">

and we changed it to

     <compilation debug="true" strict="false" optimizeCompilations="true">

So we added one switch (during the development cycle).

But to get this working, you might need to install something like:

http://support.microsoft.com/kb/961884

Blocking user agents in IIS7

I had a problem with a very specific User-Agent - GBPlugin from Brazil.

Not sure why but this User-Agent was blocking IIS7 (not my ASP.Net app but IIS7 itself :/)

To solve this, I tried blocking GBPlugin a few ways - URLScan, RequestFiltering and my own custom http module. However, eventually I worked out how to do it using the generic URL rewrite module:

http://stackoverflow.com/questions/1172933/using-web-config-to-ban-user-agents/1175333

Although I of course configured this using the IIS UI not going direct to the .config files - just felt safer on the live server.

Enabling Screen Rotation on Samsung Omnia II phone - also enabling classic Microsoft Settings Control Panel

It took a little finding - but together these guys give the solution:

• http://www.careace.net/2010/01/19/enable-screen-rotation-setting-on-samsung-omnia-ii/
• http://www.fuzemobility.com/enable-long-press-of-phone-key-to-rotate-screen/

Two registry keys to change:

1. HKLM\System\GDI\Rotation\HideOrientationUI and change the value to 0
2. HKEY_LOCAL_MACHINE\Security\Shell\StartInfo\HideSettings change to 0

Getting SQLite to work in PHP (PHP5) on Windows Server

I just wanted to use the existing code....

But it seems PHP5 underwent a big change in "PDO" for SQLite.

I went around the houses looking at errors like "Class 'SQLite3' not found php" and " Fatal error: Call to undefined function sqlite_open()"

But... finally I found: http://djhweb.co.uk/sqlite1.htm

So I had to change the code:

$db = sqlite_open('filename',0666)

to 

$db = new PDO('filename');

Then:

$res = sqlite_query($db, $query, SQLITE_ASSOC);

to

$res = $db->query($query);

And:

$row=sqlite_fetch_array($res);

to

$row=$res->fetch(PDO::FETCH_ASSOC);

I might have got some of this wrong... but hopefully not!

If you hit "SQLSTATE[HY000] [14] unable to open database file" then that means you need to open up read/write permissions on the database directory.

Doing IE6 testing

You don't want to, but sometimes you have to

When you do, then IE6 testing can be quite easily done using IETester - fab - http://www.my-debugbar.com/wiki/IETester/HomePage

Customise the grouping text in Infragistics UltraWebGrid

Really useful instructions here:

http://codecorner.galanter.net/2009/11/19/ultrawebgrid-in-outlookgroupby-mode-custom-aggregates/

Just in case I need to use PHPMailer again...

The important line was $mail->SMTPAuth = true.

Thanks to:

http://www.fasthostinghelp.com/send-mail-using-phpmailer-t98.html

$mail = new PHPMailer(); 

$mail->IsSMTP(); // send via SMTP 
$mail->Host = "mail.domain name"; // SMTP servers 
$mail->SMTPAuth = true; // turn on SMTP authentication 
$mail->Username = "Domain Email account"; // SMTP username 
$mail->Password = "password of an email account"; // SMTP password 

$mail->From = "From email account – from above mentioned domain"; 
$mail->FromName = "From Name here"; 
$mail->AddAddress("To Email account here ","Display name"); 
$mail->AddReplyTo("Reply to email account here ","Details"); 

$mail->WordWrap = 50; // set word wrap 

$mail->IsHTML(true); // send as HTML 

$mail->Subject = "Subject Line of the email"; 
$mail->Body = "Body part of the message – email details</b>"; 
$mail->AltBody = "Alternate part of the body"; 

if(!$mail->Send()) 
{ 
echo "Message did not sent <p>"; 
echo "Mailer Error: " . $mail->ErrorInfo; 
exit; 
} 

echo "Message has been sent"; 

?>

Writing a DNN skin - need to get parent tab name

John Mitchell to the answer:

http://www.snapsis.com/DotNetNuke/Support/tabid/560/aff/12/aft/5003/afv/topic/Default.aspx

Have you ever wanted to get at more than just <%= SkinPath %>in your skin?

Maybe you want to display the name of the currently Active Page?

<%=PortalSettings.ActiveTab.TabName %>

Or maybe you want to display the name of the Active Page's Root level Parent?

<%=PortalSettings.ActiveTab.BreadCrumbs(0).TabName%>

If you want the currently Active Page's immediate Parent Tab Name try this:

<%=PortalSettings.ActiveTab.BreadCrumbs(PortalSettings.ActiveTab.Level - 1).TabName %>

When Visual Studio 2008 keeps crashing

It's happened to me before and it's so annoying

Visual Studio just crashes and crashes and crashes - and it's not so easy to work out what to do...

First try the log file:

http://blogs.msdn.com/saraford/archive/2008/11/27/did-you-know-there-s-a-way-to-have-visual-studio-log-its-activity-for-troubleshooting-366.aspx

Then try the reset commands... basically type /? on the command line and you get options like /resetskippkgs and /resetaddin and /resetsettings

I'll try anything - I just want to get on with work!

MonoTouch - if you can't see any Provisioning Profiles

If MonoDevelop can't see any Provisioning Profiles, but XCode can, then maybe just maybe:

Distribution identity is not shown in MonoDevelop project signing options

MonoDevelop 2.2 has a bug that causes it not to detect distribution certificates that contain a comma. Apreview build of MonoDevelop 2.2.1 is currently available that fixes this issue.

from http://monotouch.net/Documentation/Troubleshoot

This worked for me!